-- Logs begin at Fri 2022-07-01 06:21:41 UTC, end at Fri 2022-07-01 07:40:27 UTC. -- Jul 01 06:59:50.846720 dv-cinder-807215-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 06:59:50.854019 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 06:59:50 2022] *** Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: nodename: dv-cinder-807215-2-iscsi Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: machine: x86_64 Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: clock source: unix Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: pcre jit disabled Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: detected number of CPU cores: 4 Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: current working directory: / Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: detected binary path: /usr/bin/uwsgi-core Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: your processes number limit is 47680 Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: your memory page size is 4096 bytes Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: detected max file descriptor number: 2048 Jul 01 06:59:50.857364 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: lock engine: pthread robust mutexes Jul 01 06:59:50.858314 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: thunder lock: enabled Jul 01 06:59:50.858314 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 06:59:50.858314 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 06:59:50.901306 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: Python main interpreter initialized at 0x562726e099c0 Jul 01 06:59:50.901306 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: python threads support enabled Jul 01 06:59:50.901306 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: your server socket listen backlog is limited to 100 connections Jul 01 06:59:50.901306 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: your mercy for graceful operations on workers is 90 seconds Jul 01 06:59:50.901659 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 06:59:50.901749 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: *** Operational MODE: preforking *** Jul 01 06:59:50.901959 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: *** uWSGI is running in multiple interpreter mode *** Jul 01 06:59:50.901959 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: spawned uWSGI master process (pid: 103332) Jul 01 06:59:50.902157 dv-cinder-807215-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 06:59:50.904488 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: spawned uWSGI worker 1 (pid: 103333, cores: 1) Jul 01 06:59:50.904488 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: spawned uWSGI worker 2 (pid: 103334, cores: 1) Jul 01 06:59:50.904488 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 06:59:51.553718 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 06:59:51.560140 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 06:59:52.691425 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 06:59:52.691425 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: from cryptography.utils import int_from_bytes Jul 01 06:59:52.692093 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 06:59:52.692093 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: from cryptography.utils import int_from_bytes Jul 01 06:59:52.695625 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 06:59:52.695625 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: from cryptography.utils import int_from_bytes Jul 01 06:59:52.696074 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 06:59:52.696074 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: from cryptography.utils import int_from_bytes Jul 01 06:59:55.178855 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 06:59:55.179521 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 06:59:55.179621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 06:59:55.179944 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 06:59:55.180193 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 06:59:55.180505 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 06:59:55.180857 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.180946 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 06:59:55.181041 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.181181 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.181326 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 06:59:55.181493 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.181603 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 06:59:55.181811 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.181916 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 06:59:55.182114 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.182202 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.182425 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.182519 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.182739 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.182879 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.183085 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.183175 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.183340 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.183471 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.183642 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.183782 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.183960 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-807215-2-iscsi {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.184822 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.185025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.185154 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.185327 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.185481 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.185625 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.185719 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.185938 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.186045 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.186235 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.186324 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-807215-2-iscsi {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.186548 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.186637 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.186867 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.186978 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.187237 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.187375 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.187795 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.187922 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.188038 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.188146 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.188272 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.188382 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.188496 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.188669 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.188973 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.189194 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.189388 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.189563 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.189747 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.189923 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.190064 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.190234 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.190404 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.190572 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.190712 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.190928 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.191096 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-807215-2-iscsi {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.191296 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.191441 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.191652 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.191794 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.191972 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.192153 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.192366 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.192562 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.192765 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.192942 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.193140 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-807215-2-iscsi {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.193319 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.193530 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.193697 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.193852 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.193978 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.194120 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.194276 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.194410 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.194536 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.194659 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.194825 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.194987 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.195115 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.195246 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.195371 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.195628 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.195771 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.195898 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.196028 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.196152 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.196304 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.196432 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.196571 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.196571 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.196815 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.196950 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.197081 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.197215 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.197348 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.197473 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.197603 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.197727 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.197854 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.198053 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.198179 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.198302 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.198430 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.198560 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.198687 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.198853 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.199099 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.199227 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.199351 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.199481 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.199620 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.200358 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.200499 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.200626 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.200750 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.200876 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.201012 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.201144 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.201268 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.201392 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.201522 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.201656 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.201790 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.201921 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.202046 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.202179 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.202303 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.202435 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.202560 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.202683 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.202843 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.202971 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.203095 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.203227 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.203358 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.203496 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.203627 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.203740 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.203860 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.203994 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.204117 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.204239 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.204362 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.204538 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.204745 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.204883 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.205009 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.205132 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.205264 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.205435 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.205608 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.205807 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.205935 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.206066 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.206197 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.206321 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.206457 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.206606 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.206742 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.207305 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.207509 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.207654 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.207814 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.207966 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.208114 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.208263 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.208405 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.208562 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.208705 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.208848 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.208990 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.209218 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.209364 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.209521 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.209665 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.209822 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.209968 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.210103 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.210229 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.210365 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.210490 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.210613 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.210734 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.210884 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.211008 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.211144 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.211270 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.211394 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.211517 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.211648 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.211779 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.211911 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.212036 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.212159 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.212295 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.212427 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.213088 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.213223 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.213350 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.213474 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.213598 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.213730 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.213862 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.213994 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.214119 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.214242 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.214367 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.214500 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.214626 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.214759 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.214927 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.215051 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.215174 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.215310 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.215445 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.215576 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.215708 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.215911 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.216046 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.216188 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.216314 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.216438 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.216571 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.216696 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.216819 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.216954 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.217079 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.217202 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.217326 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.217449 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.217573 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.217704 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.217829 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.217951 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.218084 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.218222 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.218347 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.218479 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.218604 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.218728 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.218876 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.219013 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.219147 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.219348 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.219482 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.219615 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.219739 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.219862 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.219994 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.220119 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.220242 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.220379 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.220504 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.220638 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.220777 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.220909 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.221045 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.221179 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.221303 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.221425 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.221558 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.221682 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.221806 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.221929 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.222091 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.222233 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.222388 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.222516 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.222699 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.222871 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.223041 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.223183 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.223349 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.223476 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.223651 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.223779 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.223951 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.224094 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.224264 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 06:59:55.224393 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.224593 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.224721 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.224920 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.225057 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.225236 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.225362 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.225543 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.225678 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.225848 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.226059 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.226198 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.226330 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.226454 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.226576 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.226747 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.226899 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.227088 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.227217 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.227400 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.227527 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.227705 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.227832 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.228041 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.228189 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.228314 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.228437 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.228594 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.228726 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.228912 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.229038 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.229220 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.229369 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.229571 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.229700 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.229824 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.229947 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.230131 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.230261 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.230438 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.230574 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.230750 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.230915 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.231108 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.231246 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.231414 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.231552 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.231719 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.231845 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.232020 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.232163 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.232334 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.232462 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.232655 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.232783 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.232959 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.233096 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.233269 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.233397 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.233573 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.233701 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.233876 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.234011 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.234176 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.234304 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.234478 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.234606 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.234818 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.234963 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.235119 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.235246 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.235449 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.235583 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.235718 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.235843 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.236006 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.236210 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.236338 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.236462 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.236600 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.236727 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.236894 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.237024 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.237192 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.237318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.237488 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.237618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.237785 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.237913 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.238084 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.238221 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.238384 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.238514 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.238682 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.238827 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.239017 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.239158 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.239325 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.239454 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.239658 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.239799 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.239926 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.240057 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.240191 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.240316 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.240489 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.240619 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.240788 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.240929 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.241088 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.241216 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.241385 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.241522 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.241688 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.241825 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.241989 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.242117 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.242287 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.242415 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.242596 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.242726 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.242919 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.243048 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.243218 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.243347 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.243516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.243643 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.243815 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.243942 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.244113 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.244241 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.244412 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.244539 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.244720 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.244847 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.245022 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.245166 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.245323 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.245451 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.245626 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.245747 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.245927 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.246063 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.246268 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.246403 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.246535 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.247225 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.247388 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.247526 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.247698 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.247834 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.248006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.248135 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.248313 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.248454 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.248629 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.248754 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.248938 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.249064 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.249236 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.249363 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.249538 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.249666 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.249865 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.249993 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.250127 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.250264 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.250390 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.250514 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.250689 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.250848 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.251011 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.251142 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.251311 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.251440 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.251609 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.251737 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.251906 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.252036 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.252202 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.252339 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.252517 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.252724 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.252852 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.252984 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.253109 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.253234 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.253389 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.253530 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.253688 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.253825 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.254014 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.254141 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.254311 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.254452 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.254626 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.254760 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.254950 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.255076 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.255243 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.255382 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.255544 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.255673 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.255843 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.255971 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.256181 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.256324 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.256525 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.256660 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.256786 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.256909 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.257070 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.257206 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.257375 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.257505 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.257691 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.257819 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.257998 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.258128 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.258312 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.258450 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.258618 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.258753 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.258952 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.259082 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.259256 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.259383 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.259563 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.259689 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.259910 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.260045 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.260177 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.260309 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.260478 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.260613 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.260787 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.260964 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.261095 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.261224 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.261397 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.261534 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.261702 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.261831 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.262003 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.262129 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.262881 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.263019 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.263193 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.263308 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.263537 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.263653 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.263847 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.263970 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.264161 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.264281 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.264467 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.264604 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.264780 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.264910 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.265085 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.265212 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.265393 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.265529 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.265696 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.265824 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.266000 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.266136 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.266297 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.266432 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.266643 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.266792 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.266920 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.267057 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.267223 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.267359 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.267542 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.267672 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.267846 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.267974 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.268158 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.268297 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.268459 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.268600 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.268763 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.268883 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.269477 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.269623 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.269757 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.269883 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.270098 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.270225 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.270358 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.270492 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.270617 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.270741 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.270891 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.271018 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.271142 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.271284 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.271418 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.271544 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.271668 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.271792 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.271915 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.272049 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.272183 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.272308 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.272434 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.272558 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.272699 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.272825 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.272949 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.273072 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.273196 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.273319 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.273474 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.273603 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.273788 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.273916 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.274089 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.274211 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.274387 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.274516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.274692 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.274876 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.275014 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.275138 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.275306 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.275444 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.275606 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.275741 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.275904 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.276045 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.276228 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.276364 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.276529 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.276677 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.276867 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.277008 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.277141 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.277275 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.277423 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.277549 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.277724 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.278370 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.278561 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.278690 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.278888 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.279018 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.279197 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.279336 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.279515 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.279644 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.279827 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.280019 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.280233 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.280362 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.280489 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.280612 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.280735 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.280858 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.280991 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.281117 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.281290 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.281418 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.281605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.281733 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.281929 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.282056 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.282201 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.282340 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.282504 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.282633 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.282819 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.282951 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.283123 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.283251 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.283427 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.283566 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.283730 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.283997 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.284134 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.284327 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.284455 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.284631 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.284761 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.284936 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.285064 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.285244 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.285371 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.285554 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.285687 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.285874 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.286109 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.286236 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.286437 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.286566 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.286750 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.287044 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.287176 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.287300 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.287425 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.287549 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.287681 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.287809 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.287991 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.288127 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.288293 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.288431 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.288594 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.288734 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.288908 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.289082 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.289230 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.289362 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.289487 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.289765 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.289889 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.290061 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.290203 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.290391 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.290533 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.290659 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.290840 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.290969 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.291105 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.291238 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.291409 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.291539 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.291663 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.291838 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.291968 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.292136 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.292276 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.292429 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.292555 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.292728 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.292856 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.293025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.293167 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.293323 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.293497 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.294183 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.294319 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.294487 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.294617 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.294832 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.294977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.295145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.295285 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.295447 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.295577 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.295749 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.295878 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.296052 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.296183 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.296384 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.296512 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.296683 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.296812 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.296980 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.297186 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.297328 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.297456 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.297580 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.297711 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.297836 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.297969 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.298142 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.298273 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.298442 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.298570 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.298744 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.298927 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.299056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.299180 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.299356 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.299484 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.299659 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.299796 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.299957 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.300085 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.300266 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.300409 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.300606 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.300746 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.300872 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.300995 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.301118 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.301249 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.301428 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.301558 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.301724 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.301850 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.302019 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.302145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.302318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.302459 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.302613 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.302739 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.302947 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.303076 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.303246 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.303374 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.303542 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.303676 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.303841 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.303969 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.304141 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.304277 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.304440 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.304571 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.304734 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.304869 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.305031 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.305157 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.305341 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.305468 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.305637 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.305845 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.305973 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.306096 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.306220 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.306357 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.306506 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.306644 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.306821 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.306951 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.307123 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.307336 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.307472 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.307607 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.307741 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.307874 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.307999 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.308124 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.308304 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.308434 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.308601 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.308730 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.308898 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.309025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.309221 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.309350 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.309842 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.309979 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.310104 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.310347 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.310492 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.310642 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.310851 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.310982 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.311108 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.311233 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.311370 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.311505 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.311643 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.311813 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.311952 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.312109 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.312238 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.312409 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.312547 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.312707 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.312835 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.313006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.313214 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.313341 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.313473 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.313599 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.313723 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.313884 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.314015 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.314204 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.314332 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.314513 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.314640 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.314835 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.314967 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.315142 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.315270 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.315445 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.315585 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.315740 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.315866 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.316049 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.316178 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.316352 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.316481 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.316657 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.316786 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.316954 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.317083 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.317250 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.317464 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.317594 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.317726 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.317852 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.317976 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.318142 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.318280 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.318453 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.318581 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.318788 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.318920 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.319101 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.319241 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.319397 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.319524 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.319700 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.319827 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.320000 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.320128 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.320302 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.320438 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.320604 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.320733 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.320945 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.321081 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.321205 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.321331 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.321495 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.321624 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.321800 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.321938 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.322104 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.322240 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.322405 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.322534 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.322706 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.322891 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.323017 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.323141 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.323325 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.323469 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.323624 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.323753 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.323938 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.324067 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.324239 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.324380 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.324535 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.324664 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.324862 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.324991 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.325164 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.325302 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.325469 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.325598 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.325765 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.325892 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.326068 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.326204 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.326370 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.326505 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.326689 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.326846 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.327021 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.327151 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.327322 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.327464 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.327652 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.327787 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.327921 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.328048 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.328206 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.328334 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.328507 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.328635 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.328913 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.329048 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.329218 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.329348 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.329521 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.329650 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.329822 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.329957 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.330119 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.330245 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.330416 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.330558 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.330719 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.330881 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.331094 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.331229 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.331353 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.331486 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.331620 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.331754 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.331920 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.332049 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.332233 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.332370 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.332531 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.332659 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.332842 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.332971 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.333209 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.333345 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.333518 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.333646 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.333823 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.333950 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.334151 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.334277 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.334402 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.334526 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.334705 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.334883 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.335051 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.335181 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.335357 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.335486 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.335674 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.335810 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.336013 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.336141 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.336319 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.336447 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.336621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.336748 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.336936 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.337066 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.337251 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.337379 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.337554 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.337774 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.337904 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.338029 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.338164 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.338298 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.338445 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.338583 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.338758 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.338924 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.339087 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.339218 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.339400 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.339528 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.339776 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.339917 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.340097 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.340228 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.340927 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.341056 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.341259 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.341403 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.341530 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.341654 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.341834 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.341962 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.342131 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.342268 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.342435 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.342564 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.342733 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.342897 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.343070 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.343209 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.343387 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.343687 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.343813 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.343991 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.344128 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.344293 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.344424 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.344594 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.344745 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.344894 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.345143 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.345280 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.345406 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.345540 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.345665 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.345796 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.345929 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.346086 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.346215 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.346391 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.346523 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.346706 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.346854 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.347044 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.347165 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.347343 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.347474 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.347657 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.347812 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.348001 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.348129 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.348254 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.348386 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.348521 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.348658 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.348809 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.348938 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.349143 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.349272 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.349443 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.349572 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.349756 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.349884 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.350075 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.350217 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.350391 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.350518 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.350693 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.350838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.351030 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.351170 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.351374 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.351518 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.351643 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.351768 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.351921 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.352060 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.352248 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.352376 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.352545 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.352673 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.352841 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.352970 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.353141 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.353270 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.353439 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.353576 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.353736 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.353874 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.354034 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.354163 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.354335 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.354464 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.354631 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.354761 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.354940 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.355099 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.355239 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.355422 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.355563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.355724 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.355852 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.356572 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.356707 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.356889 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.357028 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.357191 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.357327 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.357495 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.357624 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.357799 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.357929 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.358130 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.358266 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.358392 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.358523 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.358661 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.358826 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.358990 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.359119 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.359310 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.359440 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.359616 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.359746 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.359933 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.360071 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.360238 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.360380 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.360538 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.360674 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.360841 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.360969 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.361141 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.361280 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.361430 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.361615 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.361751 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.361878 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.362033 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.362172 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.362343 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.362472 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.362645 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.362800 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.362974 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.363117 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.363283 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.363414 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.363592 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.363721 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.363912 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.364102 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.364231 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.364423 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.364552 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.364731 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.364868 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.365037 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.365165 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.365342 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.365470 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.365647 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.365787 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.365955 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.366083 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.366258 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.366394 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.366561 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.366699 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.366892 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.367037 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.367197 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.367422 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.367560 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.367748 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.367884 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.368060 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.368270 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.368406 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.368543 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.368676 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.368802 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.368960 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.369089 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.369268 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.369410 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.369582 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.369711 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.369888 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.370016 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.370196 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.370326 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.370503 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.370641 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.370832 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.370965 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.371146 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.371277 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.371456 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.371618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.371808 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.371945 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.372071 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.372195 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.372374 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.372502 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.372680 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.372818 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.372987 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.373116 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.373290 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.373419 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.373596 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.373797 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.373933 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.374059 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.374210 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.374338 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.374525 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.374660 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.374861 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.375001 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.375173 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.375311 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.375483 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.375612 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.375798 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.375925 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.376107 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.376306 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.376444 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.376615 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.376750 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.376939 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.377060 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.377259 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.377388 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.377575 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.377704 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.377885 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.378014 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.378196 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.378400 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.378530 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.378655 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.378806 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.378933 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.379107 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.379238 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.379411 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.379670 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.379799 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.379986 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.380125 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.380295 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.380422 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.380599 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.380741 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.380896 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.381026 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.381207 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.381335 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.381510 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.381639 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.381850 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.382031 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.382174 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.382370 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.382499 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.382679 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.382860 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.383020 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.383149 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.383337 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.383467 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.383648 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.383819 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.383947 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.384071 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.384243 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.384372 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.384544 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.384672 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.384843 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.384973 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.385152 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.385372 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.385510 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.385719 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.385851 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.386033 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.386160 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.386337 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.386479 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.386639 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.386795 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.386962 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.387092 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.387291 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.387423 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.387591 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.387727 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.387908 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.388043 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.388209 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.388339 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.388541 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.388677 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.388803 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.388935 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.389069 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.389185 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.389368 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.389498 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.389663 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.389792 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.389961 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.390091 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.390258 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.390393 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.390563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.390836 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.390983 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.391146 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.391275 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.391458 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.391588 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.391762 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.391904 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.392090 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.392217 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.392349 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.392473 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.392652 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.392780 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.392955 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.393088 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.393253 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.393380 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.393550 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.393681 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.393848 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.393975 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.394147 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.394287 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.394448 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.394581 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.394754 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.394902 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.395077 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.395217 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.395387 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.395514 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.395688 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.395818 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.395995 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.396222 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.396353 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.396547 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.396676 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.396860 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.396989 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.397184 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.397306 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.397507 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.397630 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.397809 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.397947 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.398107 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.398235 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.398404 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.398547 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.398742 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.398921 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.399049 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.399172 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.399329 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.399467 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.399632 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.399885 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.400024 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.400218 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.400354 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.400518 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.400645 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.400819 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.400949 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.401120 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.401249 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.401422 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.401561 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.401723 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.401859 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.402025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.402226 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.402361 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.402564 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.402705 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.403358 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.403488 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.403612 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.403768 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.403903 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.404081 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.404211 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.404387 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.404514 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.404693 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.404823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.404997 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.405126 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.405296 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.405424 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.405601 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.405729 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.405902 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.406036 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.406207 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.406334 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.406513 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.406641 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.406837 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.406980 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.407148 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.407287 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.407445 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.407580 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.407791 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.407918 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.408102 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.408240 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.408415 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.408551 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.408778 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.408915 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.409040 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.409179 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.409312 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.409448 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.409617 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.409747 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.409938 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.410110 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.410238 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.410361 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.410528 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.410658 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.410873 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.411005 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.411177 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.411305 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.411513 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.411641 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.411832 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.411963 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.412132 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.412340 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.412475 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.412611 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.412746 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.412873 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.413004 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.413130 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.413305 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.413444 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.413608 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.413738 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.413904 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.414033 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.414201 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.414349 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.414504 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.414635 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.414822 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.414967 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.415122 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.415261 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.415419 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.415552 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.415716 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.415853 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.416016 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.416153 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.416316 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.416445 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.416611 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.416742 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.416906 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.417043 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.417201 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.417330 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.417496 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.417633 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.417791 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.417921 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.418089 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.418219 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.418385 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.419077 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.419283 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.419413 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.419539 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.419663 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.419795 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.419931 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.420088 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.420219 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.420411 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.420540 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.420733 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.420871 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.421041 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.421171 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.421355 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.421483 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.421656 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.421794 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.421954 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.422091 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.422256 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.422455 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.422583 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.422716 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.422989 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.423117 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.423254 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.423390 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.423525 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.423659 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.423785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.423909 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.424040 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.424168 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.424348 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.424479 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.424658 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.424785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.424963 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.425092 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.425266 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.425403 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.425570 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.425699 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.425874 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.426002 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.426192 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.426323 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.426492 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.426619 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.426830 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.426980 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.427126 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.427252 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.427452 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.427579 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.427758 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.427894 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.428062 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.428191 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.428367 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.428508 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.428676 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.428813 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.429023 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.429170 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.429310 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.429507 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.429648 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.429774 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.429898 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.430022 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.430167 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.430288 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.430478 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.430608 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.430819 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.430963 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.431142 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.431269 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.431465 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.431593 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.431752 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.431882 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.432073 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.432216 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.432380 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.432582 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.432718 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.432843 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.432975 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.433109 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.433278 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.433407 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.433587 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.433724 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.433903 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.434058 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.434232 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.434368 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.434750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 06:59:55.434908 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.435147 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.435457 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.435782 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.436108 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.436453 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.436766 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.437106 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.437434 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.437747 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.438058 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.438364 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 06:59:55.438605 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 06:59:55.589146 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO dbcounter [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Registered counter for database nova_api Jul 01 06:59:55.594153 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO dbcounter [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Registered counter for database nova_api Jul 01 06:59:55.609574 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 06:59:55.613401 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 06:59:55.616216 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writer thread running {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 06:59:55.619769 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writer thread running {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 06:59:55.672215 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.context [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a747ebb4-7590-42b4-a916-aba82f80a3cf(cell1) {{(pid=103334) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 06:59:55.675675 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.context [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a747ebb4-7590-42b4-a916-aba82f80a3cf(cell1) {{(pid=103333) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 06:59:55.675824 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 06:59:55.677391 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 06:59:55.678175 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 06:59:55.679617 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG oslo_concurrency.lockutils [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 06:59:55.680116 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 06:59:55.681124 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG oslo_concurrency.lockutils [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 06:59:55.681919 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG oslo_concurrency.lockutils [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 06:59:55.682067 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO dbcounter [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Registered counter for database nova_cell0 Jul 01 06:59:55.683880 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG oslo_concurrency.lockutils [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 06:59:55.686173 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO dbcounter [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Registered counter for database nova_cell0 Jul 01 06:59:55.687633 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO dbcounter [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Registered counter for database nova_cell1 Jul 01 06:59:55.691428 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO dbcounter [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Registered counter for database nova_cell1 Jul 01 06:59:55.695996 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 06:59:55.697620 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 06:59:55.699224 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 06:59:55.702532 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writer thread running {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 06:59:55.703467 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 06:59:55.705529 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writer thread running {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 06:59:55.840448 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writer thread running {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 06:59:55.847036 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writer thread running {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 06:59:55.850161 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO dbcounter [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Registered counter for database nova_cell0 Jul 01 06:59:55.855849 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO dbcounter [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Registered counter for database nova_cell0 Jul 01 06:59:55.859199 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 06:59:55.863517 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writer thread running {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 06:59:55.864631 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 06:59:55.869300 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writer thread running {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 06:59:56.197420 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: WARNING keystonemiddleware.auth_token [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 06:59:56.201166 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: WARNING keystonemiddleware.auth_token [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 06:59:56.204641 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: WARNING keystonemiddleware.auth_token [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 06:59:56.208409 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: WARNING keystonemiddleware.auth_token [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 06:59:56.543190 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: WARNING keystonemiddleware.auth_token [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 06:59:56.548021 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: WARNING keystonemiddleware.auth_token [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 06:59:56.549629 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: WARNING keystonemiddleware.auth_token [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 06:59:56.553876 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: WARNING keystonemiddleware.auth_token [None req-9f7e361c-5ff2-4772-b422-9eb83a28c558 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 06:59:56.554897 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562726e099c0 pid: 103334 (default app) Jul 01 06:59:56.556928 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 06:59:56.558108 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001706 Jul 01 06:59:56.558520 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Jul 1 06:59:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 06:59:56.559218 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562726e099c0 pid: 103333 (default app) Jul 01 07:01:10.972962 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:10.974719 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002167 Jul 01 07:01:10.975330 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:10.987651 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_api:SELECT=3 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:01:10.988848 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_cell0:SELECT=3 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:01:10.989914 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_cell1:SELECT=3 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:01:10.991037 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:01:11.427226 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-c1c46d79-5e82-4b1c-8209-03940e29db63 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:11.456894 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-c1c46d79-5e82-4b1c-8209-03940e29db63 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474309 Jul 01 07:01:11.457792 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jul 1 07:01:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:01:13.505047 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:13.506041 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-0e0b8f12-442a-4513-835d-28974c818995 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 01 07:01:13.506437 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:13.565829 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f1e29e7d-f956-460e-bafd-fcde8335d153 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:13.584306 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 07:01:13.584306 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: warnings.warn(msg) Jul 01 07:01:13.614198 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f1e29e7d-f956-460e-bafd-fcde8335d153 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101031 Jul 01 07:01:13.614968 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:01:13.831983 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-4629df65-7cda-414d-a0fa-1dc2bf4ef7b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:13.834380 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 07:01:13.834380 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jul 01 07:01:13.837067 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=3 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:01:13.837865 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell0:SELECT=3 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:01:13.839065 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell1:SELECT=3 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:01:13.839754 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:01:13.900912 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-4629df65-7cda-414d-a0fa-1dc2bf4ef7b1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278020 Jul 01 07:01:13.901575 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jul 1 07:01:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:01:15.964498 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f1e29e7d-f956-460e-bafd-fcde8335d153 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:15.966063 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f1e29e7d-f956-460e-bafd-fcde8335d153 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Jul 01 07:01:15.973752 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:16.081296 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-c53b2d2c-5b73-460b-83f6-fc68c281e1e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:16.098829 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 07:01:16.098829 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jul 01 07:01:16.118741 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-c53b2d2c-5b73-460b-83f6-fc68c281e1e5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145489 Jul 01 07:01:16.119360 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 07:01:16.131302 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-d2e7e47a-02e0-443f-9641-67ef6909ce4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:16.132807 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 07:01:16.132807 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: warnings.warn(msg) Jul 01 07:01:16.163810 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-d2e7e47a-02e0-443f-9641-67ef6909ce4f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036268 Jul 01 07:01:16.164744 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jul 1 07:01:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:01:18.253809 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-c53b2d2c-5b73-460b-83f6-fc68c281e1e5 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:18.254923 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-c53b2d2c-5b73-460b-83f6-fc68c281e1e5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 01 07:01:18.255265 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:18.319845 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7f0e348a-a7e4-457f-8caa-14b564f4a28d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "vcpus": 1, "id": "d2"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:18.339834 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-7f0e348a-a7e4-457f-8caa-14b564f4a28d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078860 Jul 01 07:01:18.340366 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:01:18.352706 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-a087ba47-4a7b-4ebb-9b9a-578fb982273e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:18.376243 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-a087ba47-4a7b-4ebb-9b9a-578fb982273e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027744 Jul 01 07:01:18.376959 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jul 1 07:01:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:01:20.446136 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7f0e348a-a7e4-457f-8caa-14b564f4a28d admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:20.447694 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-7f0e348a-a7e4-457f-8caa-14b564f4a28d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 01 07:01:20.448284 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:20.504752 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-957cb38b-e1dc-4efb-b296-093ba2bb6d15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:20.526090 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-957cb38b-e1dc-4efb-b296-093ba2bb6d15 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071683 Jul 01 07:01:20.526652 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:01:20.538177 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-85aa36fd-24ad-4e03-ba82-9e9821cf7f3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:20.560298 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-85aa36fd-24ad-4e03-ba82-9e9821cf7f3e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025741 Jul 01 07:01:20.560839 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jul 1 07:01:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:01:22.665716 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-957cb38b-e1dc-4efb-b296-093ba2bb6d15 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:22.667278 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-957cb38b-e1dc-4efb-b296-093ba2bb6d15 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Jul 01 07:01:22.667666 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:22.736152 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-cae2afa0-6a54-4021-8f5c-cfd717c2bda6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:22.756043 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-cae2afa0-6a54-4021-8f5c-cfd717c2bda6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080282 Jul 01 07:01:22.756743 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:01:22.769330 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-e32080a2-67ab-4a42-8f27-2e6de677071a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:22.792778 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-e32080a2-67ab-4a42-8f27-2e6de677071a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027757 Jul 01 07:01:22.793331 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jul 1 07:01:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:01:24.859573 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-cae2afa0-6a54-4021-8f5c-cfd717c2bda6 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:24.860640 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-cae2afa0-6a54-4021-8f5c-cfd717c2bda6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 01 07:01:24.861038 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:24.920239 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-4617dd4b-1ee9-4d57-a335-588789f2b01f admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:24.943909 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-4617dd4b-1ee9-4d57-a335-588789f2b01f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076756 Jul 01 07:01:24.944921 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jul 1 07:01:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:01:27.040779 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-cae2afa0-6a54-4021-8f5c-cfd717c2bda6 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:27.041799 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-cae2afa0-6a54-4021-8f5c-cfd717c2bda6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 01 07:01:27.046836 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:27.133992 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-53d45f45-6191-45d9-b51c-e57090fc6434 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "ram": 512, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:27.156423 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-53d45f45-6191-45d9-b51c-e57090fc6434 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.108465 Jul 01 07:01:27.157748 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 07:01:27.169426 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-33b9a7e3-55bd-45ac-b1e7-66d89cefb3a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:27.194376 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-33b9a7e3-55bd-45ac-b1e7-66d89cefb3a1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028661 Jul 01 07:01:27.194994 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jul 1 07:01:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:01:29.338068 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-53d45f45-6191-45d9-b51c-e57090fc6434 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:29.339450 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-53d45f45-6191-45d9-b51c-e57090fc6434 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002472 Jul 01 07:01:29.340106 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:29.411044 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-54f3df32-144a-45b4-a1c4-cb047a5021ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "swap": 0}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:29.429285 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-54f3df32-144a-45b4-a1c4-cb047a5021ae admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083459 Jul 01 07:01:29.429793 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:01:29.442615 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-d7740c15-4edb-47ac-91b9-d5a778cd19f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:29.466458 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-d7740c15-4edb-47ac-91b9-d5a778cd19f4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027638 Jul 01 07:01:29.466990 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jul 1 07:01:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:01:31.619166 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-54f3df32-144a-45b4-a1c4-cb047a5021ae admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:31.620516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-54f3df32-144a-45b4-a1c4-cb047a5021ae admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Jul 01 07:01:31.621096 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:31.681000 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-c2503e37-7285-479f-b45f-d2659cd0dec8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:31.699017 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-c2503e37-7285-479f-b45f-d2659cd0dec8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070443 Jul 01 07:01:31.699568 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:01:31.711291 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7cb12571-e2ce-461e-b348-f034a8824231 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:31.736353 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-7cb12571-e2ce-461e-b348-f034a8824231 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028501 Jul 01 07:01:31.737110 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jul 1 07:01:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:01:33.919711 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-c2503e37-7285-479f-b45f-d2659cd0dec8 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:33.920717 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-c2503e37-7285-479f-b45f-d2659cd0dec8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 01 07:01:33.921113 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:33.979533 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-70f1fe77-cb18-4eac-be27-f44292df7e94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:33.996612 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-70f1fe77-cb18-4eac-be27-f44292df7e94 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069997 Jul 01 07:01:33.997285 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:01:34.009059 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-5a13fcea-023e-468f-8972-0dd3c13007f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:34.032071 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-5a13fcea-023e-468f-8972-0dd3c13007f2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026731 Jul 01 07:01:34.032624 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jul 1 07:01:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:01:36.108802 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-70f1fe77-cb18-4eac-be27-f44292df7e94 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:01:36.109808 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-70f1fe77-cb18-4eac-be27-f44292df7e94 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 01 07:01:36.110330 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:01:36.168636 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-fb9ce816-f3a0-4f0e-98ad-c8efc5e25a26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "id": "5"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:36.197928 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-fb9ce816-f3a0-4f0e-98ad-c8efc5e25a26 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081771 Jul 01 07:01:36.198606 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jul 1 07:01:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 07:01:36.210211 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-48786811-59f4-4e63-ba58-586b3d4971ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:01:36.237416 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-48786811-59f4-4e63-ba58-586b3d4971ba admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030671 Jul 01 07:01:36.238145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jul 1 07:01:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:02:00.833504 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-fb9ce816-f3a0-4f0e-98ad-c8efc5e25a26 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:00.834498 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-fb9ce816-f3a0-4f0e-98ad-c8efc5e25a26 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jul 01 07:02:00.834927 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:00.845099 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:02:00.892664 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7167a026-78f3-4245-a741-a8046eb2506b admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:00.909380 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-7167a026-78f3-4245-a741-a8046eb2506b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068742 Jul 01 07:02:00.909906 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jul 1 07:02:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:02:01.826056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-fb9ce816-f3a0-4f0e-98ad-c8efc5e25a26 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:01.827106 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-fb9ce816-f3a0-4f0e-98ad-c8efc5e25a26 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 01 07:02:01.827503 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:02:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:02.016849 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-641b933f-3762-4323-9694-75d338e3c24f admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:02.022533 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.wsgi [None req-641b933f-3762-4323-9694-75d338e3c24f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-641b933f-3762-4323-9694-75d338e3c24f admin admin] Request method failure captured: Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Accept: application/json Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Accept-Encoding: gzip, deflate Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Connection: keep-alive Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Content-Length: 0 Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Host: 10.222.0.48 Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Openstack-Api-Version: compute 2.90 Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Openstack-System-Scope: None Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: User-Agent: python-novaclient Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Auth-Token: gAAAAABivpvpHcvXMdCCNP288dXK1n3TiZBsQ4o5XE2n8FRZhDyZCzpLH0Q7TWkYKp0Td7_CBNCwOkpmLlN26rXZyvx4seR5cYnZztJ1j3fi1uALATifM1r42Rdwi-HkvhtfkKG5K5kIGMZiivI3lIRlINzQnk2Uj3je6G3VBX2_jmPStk2fm5c Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Domain-Id: None Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Domain-Name: None Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Identity-Status: Confirmed Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Is-Admin-Project: True Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Domain-Id: default Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Domain-Name: Default Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Name: admin Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Role: admin,reader,member Jul 01 07:02:02.025823 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Roles: admin,reader,member Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0142643ea3d4627a8dc9edbdfab9d31"}]}] Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant: admin Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant-Name: admin Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User: admin Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Domain-Id: default Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Domain-Name: Default Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Id: bb77d87b954348508ac808b62617ddb0 Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Name: admin Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: method: > Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: exception: Flavor 42 could not be found. Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: action_args: {'id': '42'} Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:02:02.027526 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:02.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.030074 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-641b933f-3762-4323-9694-75d338e3c24f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:02:02.031492 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-641b933f-3762-4323-9694-75d338e3c24f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062039 Jul 01 07:02:02.031492 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jul 1 07:02:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 07:02:02.036807 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-0ce21858-8680-4aea-8943-82d6be894924 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:02.039614 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:02:02.059795 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-0ce21858-8680-4aea-8943-82d6be894924 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026314 Jul 01 07:02:02.060350 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jul 1 07:02:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:02:02.069930 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-1bb6c045-cb5d-462a-a57a-d25e1353fbe3 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:02.091469 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-1bb6c045-cb5d-462a-a57a-d25e1353fbe3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025079 Jul 01 07:02:02.091992 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jul 1 07:02:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:02:02.101289 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-f5c06e2e-5041-45af-9f64-9440d0511d77 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:02.107354 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.wsgi [None req-f5c06e2e-5041-45af-9f64-9440d0511d77 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-f5c06e2e-5041-45af-9f64-9440d0511d77 admin admin] Request method failure captured: Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Accept: application/json Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Accept-Encoding: gzip, deflate Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Connection: keep-alive Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Content-Length: 0 Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Host: 10.222.0.48 Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Openstack-Api-Version: compute 2.90 Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Openstack-System-Scope: None Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: User-Agent: python-novaclient Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Auth-Token: gAAAAABivpvpHcvXMdCCNP288dXK1n3TiZBsQ4o5XE2n8FRZhDyZCzpLH0Q7TWkYKp0Td7_CBNCwOkpmLlN26rXZyvx4seR5cYnZztJ1j3fi1uALATifM1r42Rdwi-HkvhtfkKG5K5kIGMZiivI3lIRlINzQnk2Uj3je6G3VBX2_jmPStk2fm5c Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Domain-Id: None Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Domain-Name: None Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Identity-Status: Confirmed Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Is-Admin-Project: True Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Domain-Id: default Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Domain-Name: Default Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Name: admin Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Role: admin,reader,member Jul 01 07:02:02.110563 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Roles: admin,reader,member Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0142643ea3d4627a8dc9edbdfab9d31"}]}] Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant: admin Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant-Name: admin Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User: admin Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Domain-Id: default Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Domain-Name: Default Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Id: bb77d87b954348508ac808b62617ddb0 Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Name: admin Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: method: > Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: exception: Flavor 42 could not be found. Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: action_args: {'id': '42'} Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:02:02.112025 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:02.112977 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:02.114195 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-f5c06e2e-5041-45af-9f64-9440d0511d77 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:02:02.115227 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-f5c06e2e-5041-45af-9f64-9440d0511d77 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014500 Jul 01 07:02:02.115227 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jul 1 07:02:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 07:02:02.934435 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-1bb6c045-cb5d-462a-a57a-d25e1353fbe3 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:02.935733 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-1bb6c045-cb5d-462a-a57a-d25e1353fbe3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Jul 01 07:02:02.936122 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:03.123670 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-4e8ddc6f-837e-42f9-89c6-c46428c548b9 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:03.129486 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.wsgi [None req-4e8ddc6f-837e-42f9-89c6-c46428c548b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-4e8ddc6f-837e-42f9-89c6-c46428c548b9 admin admin] Request method failure captured: Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Accept: application/json Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Accept-Encoding: gzip, deflate Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Connection: keep-alive Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Content-Length: 0 Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Host: 10.222.0.48 Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Openstack-Api-Version: compute 2.90 Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Openstack-System-Scope: None Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: User-Agent: python-novaclient Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Auth-Token: gAAAAABivpvqsA6gooEll857C8umXfWOdatXdGh27Ynx-fXfeJoESy9bIGu3omY8VHAp1G0qB18r8WrlRfAHti4LPoH4GJ44e01H8ecKiu4wyKFJ2BRfCBE8lBn2nP5jwvtP9BH2GaI5BzmVyXpN-NMvOLEiUsDsHlIISP_lPiEDD4A827N9bz8 Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Domain-Id: None Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Domain-Name: None Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Identity-Status: Confirmed Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Is-Admin-Project: True Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Domain-Id: default Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Domain-Name: Default Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Name: admin Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Role: admin,reader,member Jul 01 07:02:03.131042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Roles: admin,reader,member Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0142643ea3d4627a8dc9edbdfab9d31"}]}] Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant: admin Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant-Name: admin Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User: admin Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Domain-Id: default Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Domain-Name: Default Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Id: bb77d87b954348508ac808b62617ddb0 Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Name: admin Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: method: > Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: exception: Flavor 84 could not be found. Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: action_args: {'id': '84'} Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:02:03.132333 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:03.133145 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.134605 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-4e8ddc6f-837e-42f9-89c6-c46428c548b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:02:03.135968 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-4e8ddc6f-837e-42f9-89c6-c46428c548b9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060187 Jul 01 07:02:03.135968 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jul 1 07:02:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 07:02:03.141944 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-3518ba93-8322-4924-b0f3-c81d2a6460ff admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:03.156916 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-3518ba93-8322-4924-b0f3-c81d2a6460ff admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018525 Jul 01 07:02:03.157431 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jul 1 07:02:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:02:03.167037 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-7b518074-018f-4107-a254-0c65d7a64256 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:03.180937 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-7b518074-018f-4107-a254-0c65d7a64256 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017198 Jul 01 07:02:03.181447 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jul 1 07:02:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:02:03.190549 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f6a117c5-8a4d-4506-8f90-bd23e0d529e3 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:03.200016 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.wsgi [None req-f6a117c5-8a4d-4506-8f90-bd23e0d529e3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f6a117c5-8a4d-4506-8f90-bd23e0d529e3 admin admin] Request method failure captured: Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Accept: application/json Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Accept-Encoding: gzip, deflate Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Connection: keep-alive Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Content-Length: 0 Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Host: 10.222.0.48 Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Openstack-Api-Version: compute 2.90 Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Openstack-System-Scope: None Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: User-Agent: python-novaclient Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Auth-Token: gAAAAABivpvqsA6gooEll857C8umXfWOdatXdGh27Ynx-fXfeJoESy9bIGu3omY8VHAp1G0qB18r8WrlRfAHti4LPoH4GJ44e01H8ecKiu4wyKFJ2BRfCBE8lBn2nP5jwvtP9BH2GaI5BzmVyXpN-NMvOLEiUsDsHlIISP_lPiEDD4A827N9bz8 Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Domain-Id: None Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Domain-Name: None Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Identity-Status: Confirmed Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Is-Admin-Project: True Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Domain-Id: default Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Domain-Name: Default Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Name: admin Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Role: admin,reader,member Jul 01 07:02:03.201516 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Roles: admin,reader,member Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0142643ea3d4627a8dc9edbdfab9d31"}]}] Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant: admin Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant-Name: admin Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User: admin Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Domain-Id: default Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Domain-Name: Default Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Id: bb77d87b954348508ac808b62617ddb0 Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Name: admin Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: method: > Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: exception: Flavor 84 could not be found. Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: action_args: {'id': '84'} Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:02:03.203006 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:03.204145 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:03.205299 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f6a117c5-8a4d-4506-8f90-bd23e0d529e3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:02:03.206354 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f6a117c5-8a4d-4506-8f90-bd23e0d529e3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015774 Jul 01 07:02:03.206354 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jul 1 07:02:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 01 07:02:04.026131 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-7b518074-018f-4107-a254-0c65d7a64256 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:04.027172 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-7b518074-018f-4107-a254-0c65d7a64256 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jul 01 07:02:04.027562 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:04.215079 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7464c200-6be3-4c02-8841-9b62694f5760 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:04.220829 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.wsgi [None req-7464c200-6be3-4c02-8841-9b62694f5760 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7464c200-6be3-4c02-8841-9b62694f5760 admin admin] Request method failure captured: Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Accept: application/json Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Accept-Encoding: gzip, deflate Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Connection: keep-alive Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Content-Length: 0 Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Host: 10.222.0.48 Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Openstack-Api-Version: compute 2.90 Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Openstack-System-Scope: None Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: User-Agent: python-novaclient Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Auth-Token: gAAAAABivpvsc7ea9rw5RMhH6MTOSHRnK1ZGQDzRKN0wAgRH0bHuUoAp95EggOfGkJGgpJF6XCM0mwjPXvR7e5QbAmyDQIJkSVtXip4oa12LVOkQvjxpewWbGUFqu1djpdHJpaUbyAW3QhT97fnT7H5f4jloYD9ZT9OPhqJE1nEfw97D7XwUESQ Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Domain-Id: None Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Domain-Name: None Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Identity-Status: Confirmed Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Is-Admin-Project: True Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Domain-Id: default Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Domain-Name: Default Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Project-Name: admin Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Role: admin,reader,member Jul 01 07:02:04.222318 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Roles: admin,reader,member Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0142643ea3d4627a8dc9edbdfab9d31"}]}] Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant: admin Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-Tenant-Name: admin Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User: admin Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Domain-Id: default Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Domain-Name: Default Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Id: bb77d87b954348508ac808b62617ddb0 Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: X-User-Name: admin Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: method: > Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: exception: Flavor 451 could not be found. Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: action_args: {'id': '451'} Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:02:04.223838 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:04.224785 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.226139 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7464c200-6be3-4c02-8841-9b62694f5760 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:02:04.227421 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-7464c200-6be3-4c02-8841-9b62694f5760 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060568 Jul 01 07:02:04.227421 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jul 1 07:02:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 07:02:04.233318 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-71b9a513-d089-4309-a60d-10e1d4215d68 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:04.250401 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-71b9a513-d089-4309-a60d-10e1d4215d68 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020485 Jul 01 07:02:04.250928 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jul 1 07:02:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:02:04.260867 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:04.274302 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017565 Jul 01 07:02:04.274835 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jul 1 07:02:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:02:04.283377 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-ea8b4f90-84b8-453a-85ea-2d3cbf1bf1f8 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:04.288553 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.wsgi [None req-ea8b4f90-84b8-453a-85ea-2d3cbf1bf1f8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-ea8b4f90-84b8-453a-85ea-2d3cbf1bf1f8 admin admin] Request method failure captured: Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Accept: application/json Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Accept-Encoding: gzip, deflate Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Connection: keep-alive Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Content-Length: 0 Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Host: 10.222.0.48 Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Openstack-Api-Version: compute 2.90 Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Openstack-System-Scope: None Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: User-Agent: python-novaclient Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Auth-Token: gAAAAABivpvsc7ea9rw5RMhH6MTOSHRnK1ZGQDzRKN0wAgRH0bHuUoAp95EggOfGkJGgpJF6XCM0mwjPXvR7e5QbAmyDQIJkSVtXip4oa12LVOkQvjxpewWbGUFqu1djpdHJpaUbyAW3QhT97fnT7H5f4jloYD9ZT9OPhqJE1nEfw97D7XwUESQ Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Domain-Id: None Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Domain-Name: None Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Identity-Status: Confirmed Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Is-Admin-Project: True Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Domain-Id: default Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Domain-Name: Default Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Project-Name: admin Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Role: admin,reader,member Jul 01 07:02:04.290045 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Roles: admin,reader,member Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0142643ea3d4627a8dc9edbdfab9d31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0142643ea3d4627a8dc9edbdfab9d31"}]}] Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant: admin Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant-Id: b0142643ea3d4627a8dc9edbdfab9d31 Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-Tenant-Name: admin Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User: admin Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Domain-Id: default Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Domain-Name: Default Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Id: bb77d87b954348508ac808b62617ddb0 Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: X-User-Name: admin Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: method: > Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: exception: Flavor 451 could not be found. Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: action_args: {'id': '451'} Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:02:04.291621 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:04.292750 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jul 01 07:02:04.294056 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-ea8b4f90-84b8-453a-85ea-2d3cbf1bf1f8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:02:04.295351 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-ea8b4f90-84b8-453a-85ea-2d3cbf1bf1f8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011390 Jul 01 07:02:04.295351 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jul 1 07:02:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 07:02:05.103002 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:05.104012 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 01 07:02:05.104424 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:02:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:05.294222 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-3f783968-9683-4dff-b46c-8b4d9d95e0b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:02:05.312276 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-3f783968-9683-4dff-b46c-8b4d9d95e0b7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069785 Jul 01 07:02:05.312856 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jul 1 07:02:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:02:06.124961 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:06.125993 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 01 07:02:06.126406 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:02:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:06.314253 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-5cfb4962-eb84-4a69-8480-7ab1d0b114f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:02:06.331526 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-5cfb4962-eb84-4a69-8480-7ab1d0b114f0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068844 Jul 01 07:02:06.332059 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jul 1 07:02:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:02:07.142035 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:07.143100 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 01 07:02:07.143492 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:07.336202 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-eb8324bc-d5e5-41ee-b433-af16d7466c73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:02:07.354182 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-eb8324bc-d5e5-41ee-b433-af16d7466c73 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069334 Jul 01 07:02:07.354652 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jul 1 07:02:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:02:08.169487 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:08.170551 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 01 07:02:08.170980 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:02:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:08.356930 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-09f50151-5525-40fc-8b45-c0776006e062 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:02:08.374598 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-09f50151-5525-40fc-8b45-c0776006e062 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067551 Jul 01 07:02:08.375164 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jul 1 07:02:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:02:09.201620 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:09.202629 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 01 07:02:09.203056 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:02:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:09.391396 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-d90b7b9a-2b15-44f9-8130-67763174f015 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:09.410133 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-d90b7b9a-2b15-44f9-8130-67763174f015 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070096 Jul 01 07:02:09.410666 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Jul 1 07:02:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:02:55.695555 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:55.696572 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-71f3f83d-76b3-496d-b6d4-e41c1d8aca4f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 01 07:02:55.696968 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jul 1 07:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:02:55.707294 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:02:55.755053 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-7ecdeb92-7c13-4197-bbe9-5538ef31c77e admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:55.776077 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-7ecdeb92-7c13-4197-bbe9-5538ef31c77e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073233 Jul 01 07:02:55.776742 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jul 1 07:02:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:02:55.799629 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-e9e2608c-c874-4fa3-a490-94aa23297fca admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:55.803057 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_api:SELECT=14 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:02:55.808578 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-e9e2608c-c874-4fa3-a490-94aa23297fca admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012518 Jul 01 07:02:55.809091 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jul 1 07:02:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:02:55.820627 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-2fe2c770-f2c2-4037-915a-0dd47e0c4385 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:55.828071 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-2fe2c770-f2c2-4037-915a-0dd47e0c4385 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010905 Jul 01 07:02:55.828573 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jul 1 07:02:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:02:55.840057 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:55.847370 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010742 Jul 01 07:02:55.847870 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jul 1 07:02:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:02:55.859033 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-23845e7d-d1ab-45be-94c3-d081ed28577d admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:02:55.866237 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-23845e7d-d1ab-45be-94c3-d081ed28577d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010524 Jul 01 07:02:55.866740 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jul 1 07:02:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:06:15.100289 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:06:15.101286 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 01 07:06:15.101670 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:06:15.240545 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=6 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:06:15.353470 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-583e8c4d-f9ac-4092-9e18-022fa12cde02 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:06:15.354655 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 07:06:15.354655 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jul 01 07:06:15.355931 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-583e8c4d-f9ac-4092-9e18-022fa12cde02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:06:15.356359 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-583e8c4d-f9ac-4092-9e18-022fa12cde02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:06:15.357131 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-583e8c4d-f9ac-4092-9e18-022fa12cde02 admin admin] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:06:15.357551 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-583e8c4d-f9ac-4092-9e18-022fa12cde02 admin admin] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:06:15.391618 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-583e8c4d-f9ac-4092-9e18-022fa12cde02 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152613 Jul 01 07:06:15.392161 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jul 1 07:06:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:06:16.214398 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:06:16.215428 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 01 07:06:16.215834 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:06:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:06:16.405999 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-615529ce-2afa-4655-be4d-6e5bf7431df2 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:06:16.407216 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 07:06:16.407216 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jul 01 07:06:16.408397 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-615529ce-2afa-4655-be4d-6e5bf7431df2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:06:16.408839 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-615529ce-2afa-4655-be4d-6e5bf7431df2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:06:16.409647 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-615529ce-2afa-4655-be4d-6e5bf7431df2 admin admin] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:06:16.410072 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-615529ce-2afa-4655-be4d-6e5bf7431df2 admin admin] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:06:16.429986 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-615529ce-2afa-4655-be4d-6e5bf7431df2 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076294 Jul 01 07:06:16.430459 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jul 1 07:06:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:06:27.666671 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:06:27.667681 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 01 07:06:27.668101 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:06:27.810979 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell0:SELECT=4 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:06:27.811862 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell1:SELECT=4 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:06:27.812480 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=8 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:06:27.861042 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-6188ccbf-aee3-48f1-9b6b-cf8f961aedea admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:06:27.862280 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 07:06:27.862280 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jul 01 07:06:27.863492 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-6188ccbf-aee3-48f1-9b6b-cf8f961aedea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:06:27.863932 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-6188ccbf-aee3-48f1-9b6b-cf8f961aedea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:06:27.864717 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-6188ccbf-aee3-48f1-9b6b-cf8f961aedea admin admin] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:06:27.865141 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-6188ccbf-aee3-48f1-9b6b-cf8f961aedea admin admin] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:06:27.890111 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-6188ccbf-aee3-48f1-9b6b-cf8f961aedea admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083868 Jul 01 07:06:27.890607 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jul 1 07:06:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:06:28.718447 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:06:28.719509 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-992adc7a-b5e0-41e9-a187-cde5a66a4c81 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 01 07:06:28.719903 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jul 1 07:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:06:28.907766 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-b60d84a9-e8d8-49e9-90b5-c8e43fdb5405 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:06:28.909557 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 07:06:28.909557 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jul 01 07:06:28.910752 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-b60d84a9-e8d8-49e9-90b5-c8e43fdb5405 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:06:28.911211 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-b60d84a9-e8d8-49e9-90b5-c8e43fdb5405 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:06:28.912001 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-b60d84a9-e8d8-49e9-90b5-c8e43fdb5405 admin admin] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:06:28.912424 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-b60d84a9-e8d8-49e9-90b5-c8e43fdb5405 admin admin] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:06:28.938096 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-b60d84a9-e8d8-49e9-90b5-c8e43fdb5405 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080494 Jul 01 07:06:28.938917 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jul 1 07:06:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:07:26.578962 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: Fri Jul 1 07:07:26 2022 - graceful shutdown triggered... Jul 01 07:07:26.578923 dv-cinder-807215-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 01 07:07:26.579899 dv-cinder-807215-2-iscsi devstack@n-api.service[103333]: Gracefully killing worker 1 (pid: 103333)... Jul 01 07:07:26.580288 dv-cinder-807215-2-iscsi devstack@n-api.service[103334]: Gracefully killing worker 2 (pid: 103334)... Jul 01 07:07:27.580325 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: worker 1 buried after 1 seconds Jul 01 07:07:27.580325 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: worker 2 buried after 1 seconds Jul 01 07:07:27.580325 dv-cinder-807215-2-iscsi devstack@n-api.service[103332]: goodbye to uWSGI. Jul 01 07:07:27.581804 dv-cinder-807215-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 01 07:07:27.582364 dv-cinder-807215-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 01 07:07:27.585182 dv-cinder-807215-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 07:07:27.598201 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 07:07:27 2022] *** Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: nodename: dv-cinder-807215-2-iscsi Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: machine: x86_64 Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: clock source: unix Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: pcre jit disabled Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: detected number of CPU cores: 4 Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: current working directory: / Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: detected binary path: /usr/bin/uwsgi-core Jul 01 07:07:27.600819 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: your processes number limit is 47680 Jul 01 07:07:27.601660 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: your memory page size is 4096 bytes Jul 01 07:07:27.601660 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: detected max file descriptor number: 2048 Jul 01 07:07:27.601660 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: lock engine: pthread robust mutexes Jul 01 07:07:27.601660 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: thunder lock: enabled Jul 01 07:07:27.601660 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 07:07:27.601660 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 07:07:27.646933 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: Python main interpreter initialized at 0x55ea058cd9c0 Jul 01 07:07:27.646933 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: python threads support enabled Jul 01 07:07:27.646933 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: your server socket listen backlog is limited to 100 connections Jul 01 07:07:27.646933 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: your mercy for graceful operations on workers is 90 seconds Jul 01 07:07:27.647271 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 07:07:27.647365 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: *** Operational MODE: preforking *** Jul 01 07:07:27.647849 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: *** uWSGI is running in multiple interpreter mode *** Jul 01 07:07:27.647983 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: spawned uWSGI master process (pid: 117819) Jul 01 07:07:27.648368 dv-cinder-807215-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 07:07:27.649244 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: spawned uWSGI worker 1 (pid: 117835, cores: 1) Jul 01 07:07:27.649244 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: spawned uWSGI worker 2 (pid: 117836, cores: 1) Jul 01 07:07:27.649444 dv-cinder-807215-2-iscsi devstack@n-api.service[117819]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 07:07:28.320087 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 07:07:28.322892 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 07:07:29.525565 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 07:07:29.525565 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: from cryptography.utils import int_from_bytes Jul 01 07:07:29.526252 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 07:07:29.526252 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: from cryptography.utils import int_from_bytes Jul 01 07:07:29.526404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 07:07:29.526404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: from cryptography.utils import int_from_bytes Jul 01 07:07:29.526822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 07:07:29.526822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: from cryptography.utils import int_from_bytes Jul 01 07:07:31.946205 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 07:07:31.946834 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 07:07:31.947314 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 07:07:31.947442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 07:07:31.947653 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 07:07:31.948050 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.948381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.948697 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.949021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.949352 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.949665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.949989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.950311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.950639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.950928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.951244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.952031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-807215-2-iscsi {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.952031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.952195 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.952487 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.952808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.953118 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.953443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.953874 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.954239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.955482 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.955610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 07:07:31.955610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 07:07:31.956214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.956320 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 07:07:31.956401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.956473 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 07:07:31.956473 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 07:07:31.956715 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.956860 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.957151 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.957333 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.957486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.957722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.957890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.958108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.958336 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.958551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.958761 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.959030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.959245 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.959458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.959662 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.959878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.960098 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-807215-2-iscsi {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.960800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.961000 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.961190 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.961377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.961525 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-807215-2-iscsi {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.961684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.961867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.961867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.962154 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.962310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.962484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.962672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.962861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.963021 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.963204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.963351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.963531 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.963687 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.963866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.963866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.964140 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.964305 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.964862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.965025 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.965177 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.965177 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.965755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.965755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.966136 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.966275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.966696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.967119 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.968150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.968263 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.968436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.968436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.968608 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.968682 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.968802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.968907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969169 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-807215-2-iscsi {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969262 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969360 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969492 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969587 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969767 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969850 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.969950 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970141 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970236 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970328 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970544 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970544 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970829 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.970931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971215 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971306 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971390 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971473 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971568 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971653 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.971989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972205 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972304 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972686 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972778 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.972951 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973457 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.973934 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.974085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.974214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.974401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.974500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.974709 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.974851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.975044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.975136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.975359 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.975516 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.975667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.975773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.975976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.976074 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.976283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.976377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.976596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.976701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.976901 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.976999 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.977182 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.977279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.977489 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.977656 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.977902 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.978119 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.978240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.978334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.978418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.978503 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.978698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.978834 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.979034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.979135 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.979340 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.979434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.979650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.979753 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.979958 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.980049 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.980265 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.980368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.980575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.980680 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.980883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.980982 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.981189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.981288 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.981497 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.981636 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.981803 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.981891 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.982106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.982196 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.982425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.982528 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.982749 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.982906 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.983079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.983191 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.983332 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.983440 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.983917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984195 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984291 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984390 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984634 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.984927 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.985142 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.985366 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.985487 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.986265 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.986595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.986929 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.987093 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.987288 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.987464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.987597 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.987815 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.987925 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.988138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.988362 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.988474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.988696 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.988822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.989040 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.989220 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.989381 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.990931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991076 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991165 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991241 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991241 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991372 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991456 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991530 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991603 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991603 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.991923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.992005 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.992166 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.992306 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.992653 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.992806 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.992896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.993075 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.993281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.993379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.993533 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.993633 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.993820 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.993921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.994186 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.994300 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.994519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.994623 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.994872 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.994972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.995186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.995294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.995499 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.995604 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.995808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.995949 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.996116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.996226 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.996425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.996527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:31.996734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.997042 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.997158 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:31.997350 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.997445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:31.997651 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.998057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.998163 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:31.998301 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.998593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:31.998697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.998933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.999125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:31.999229 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.999461 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:31.999564 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 07:07:31.999787 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:31.999910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.000107 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.000218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.000441 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.000551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.000757 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.000864 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.001073 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.001179 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.001402 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.002080 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.002351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.002495 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.002676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.002846 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.003029 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.003163 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.003349 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.003485 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.003662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.003811 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.003976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.004131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.004292 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.004433 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.004613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.004754 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.004935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.005109 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.005261 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.005398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.005538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.005677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.005880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.006014 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.006201 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.006343 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.006515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.006664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.006856 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.007006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.007181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.007313 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.007494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.007632 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.007804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.007947 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.008114 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.008255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.008474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.008616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.008787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.008923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.009113 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.009311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.009446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.009642 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.009799 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.010003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.010143 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.010275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.010404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.010552 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.010683 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.010890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.011038 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.011178 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.011317 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.011508 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.011643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.011825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.011959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.012139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.012283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.012452 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.012596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.012803 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.013108 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.013249 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.013431 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.013575 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.013748 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.013883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.014061 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.014195 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.014369 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.014506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.014677 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.014843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.015008 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.015144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.015321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.015458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.015626 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.015773 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.015934 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.016069 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.016242 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.016386 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.016550 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.016684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.016861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.017027 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.017198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.017338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.017470 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.017615 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.017773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.017922 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.018085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.018221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.018396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.018532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.018736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.018908 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.019084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.019221 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.019399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.019542 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.019714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.019858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.020005 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.020214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.020351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.020483 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.020674 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.020809 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.020940 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.021070 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.021243 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.021384 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.021524 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.021664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.021817 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.021952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.022144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.022288 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.022453 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.022588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.022791 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.022919 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.023100 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.023222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.023415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.023519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.023728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.023822 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.024041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.024150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.024355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.024473 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.024680 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.024791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.024993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.025104 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.025306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.025402 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.025637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.025745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.025942 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.026050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.026253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.026357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.026574 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.026899 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.027012 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.027213 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.027315 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.027520 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.027622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.027830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.027938 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.028132 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.028225 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.028439 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.028552 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.028737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.028846 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.029041 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.029136 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.029347 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.029517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.029667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.029827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.029973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.030127 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.030359 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.030517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.030673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.030878 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.031039 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.031185 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.031328 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.031472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.031626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.031780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.031933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.032097 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.032282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.032444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.032603 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.032777 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.032931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.033083 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.033228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.033414 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.033569 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.033715 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.033859 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.034003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.034003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.034294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.034453 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.034599 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.034742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.034914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.035060 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.035220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.035374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.035519 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.035672 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.035817 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.035968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.036142 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.036294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.036447 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.036592 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.036744 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.036888 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.037043 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.037188 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.037346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.037491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.037636 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.037780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.037938 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.038095 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.038240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.038240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.038520 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.038680 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.038944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.038944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.039240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.039383 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.039527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.039680 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.039832 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.039832 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.040133 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.040287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.040466 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.040627 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.040780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.040932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.041085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.041232 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.041384 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.041543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.041688 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.041920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.042093 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.042247 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.042392 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.042551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.042696 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.042892 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.043040 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.043185 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.043347 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.043493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.043770 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.043927 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.044073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.044228 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.044383 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.044529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.044681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.045011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.045162 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.045340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.045507 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.045655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.045816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.045973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.046126 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.046279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.046445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.046592 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.046736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.046921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.047076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.047231 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.047375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.047527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.047698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.047852 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.048006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.048166 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.048862 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.049114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.049267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.049445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.049594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.049748 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.049894 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.050045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.050190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.050190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.050470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.050693 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.050879 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.051035 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.051197 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.051342 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.051496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.051649 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.051802 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.051947 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.052098 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.052250 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.052413 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.052560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.052712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.052857 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.053020 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.053174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.053332 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.053486 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.053631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.053791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.053945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.054091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.054244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.054389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.054533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.054684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.054860 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.055037 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.055191 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.055345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.055491 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.055643 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.055789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.055948 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.056100 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.056259 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.056414 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.056559 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.056711 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.056870 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.057027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.057172 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.057325 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.057479 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.057640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.057798 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.057952 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.058105 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.058250 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.058401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.058560 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.058707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.058951 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.058951 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.059137 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.059221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.059221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.059669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.059783 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.059870 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.060082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.060196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.060394 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.060494 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.060760 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.060866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.061007 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.061134 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.061311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.061500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.061646 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.061790 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.061944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.062195 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.062483 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.062636 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.062850 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.063016 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.063181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.063345 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.063492 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.063646 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.063792 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.063988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.064700 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.064906 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.065058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.065200 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.065346 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.065528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.065693 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.065858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.066004 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.066156 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.066310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.066465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.066611 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.066755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.066983 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.067130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.067273 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.067418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.067570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.067746 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.067904 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.068050 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.068202 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.068349 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.068494 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.068652 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.068798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.068942 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.069169 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.069401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.069553 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.069709 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.069895 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.070040 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.070198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.070344 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.070488 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.070666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.070839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.071002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.071156 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.071310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.071464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.071611 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.071756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.071910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.072063 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.072218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.072374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.072520 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.072666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.072809 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.072953 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.073097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.073289 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.073437 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.073589 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.073743 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.073907 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.074062 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.074216 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.074361 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.074505 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.074657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.074842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.075008 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.075155 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.075307 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.075461 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.075613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.075768 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.075923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.076076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.076230 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.076382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.076527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.076677 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.076833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.076986 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.077138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.077291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.077479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.077647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.077814 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.077969 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.078115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.078260 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.078404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.078562 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.078708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.078887 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.079045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.079208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.079441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.079690 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.079851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.080010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.080156 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.080301 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.080446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.080667 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.080822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.081008 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.081161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.081313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.081459 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.081650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.081807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.081953 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.082110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.082255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.082413 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.082559 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.082704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.082902 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.083059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.083213 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.083368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.083523 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.083523 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.083798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.083952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.083952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.084259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.084406 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.084559 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.084712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.084712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.084996 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.085150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.085150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.085437 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.085581 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.085732 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.085900 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.086046 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.086197 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.086471 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.086631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.086806 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.087061 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.087222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.087400 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.087724 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.087881 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.088036 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.088346 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.088513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.088666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.088948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.089099 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.089294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.089470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.089716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.089957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.090118 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.090299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.090462 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.090610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.090761 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.091029 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.091175 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.091320 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.091472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.091619 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.091763 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.091916 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.092069 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.092224 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.092379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.092722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.093031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.093337 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.093684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.093990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.094368 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.094600 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.094940 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.095116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.095331 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.095529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.095809 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.095969 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.096170 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.096464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.096634 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.096797 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.097051 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.097222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.097375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.097689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.097851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.098012 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.098297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.098454 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.098605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.098835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.099125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.099310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.099503 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.099835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.100168 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.100337 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.100501 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.100722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.100888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.101114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.101271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.101422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.101605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.101765 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.102040 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.102198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.102358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.102510 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.102677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.102860 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.103018 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.103169 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.103331 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.103484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.103648 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.103808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.103970 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.104135 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.104287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.104446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.104606 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.104757 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.104907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.105057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.105209 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.105374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.105534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.105694 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.105846 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.105997 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.106166 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.106334 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.106495 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.106654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.106863 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.107030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.107191 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.107357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.107517 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.107668 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.107820 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.107977 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.108150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.108304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.108464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.108629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.108781 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.108932 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.108932 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.109231 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.109231 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.109535 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.109694 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.109866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.110119 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.110294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.110463 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.110615 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.111316 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.111491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.111654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.111814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.111814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.112110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.112272 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.112432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.112593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.112745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.112745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.113059 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.113210 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.113370 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.113523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.113682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.113842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.113842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.114129 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.114293 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.114453 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.114614 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.114815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.114815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.115133 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.115295 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.115455 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.115607 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.115766 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.115917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.116078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.116230 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.116388 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.116540 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.116691 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.116859 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.117020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.117171 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.117331 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.117484 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.117634 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.117794 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.117794 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.118100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.118251 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.118409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.118563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.118828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.119065 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.119233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.119385 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.119543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.119695 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.119856 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.120010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.120250 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.120409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.120560 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.120727 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.120891 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.121043 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.121205 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.121357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.121517 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.121687 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.121847 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.122001 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.122162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.122314 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.122479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.122639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.122840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.123000 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.123177 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.123338 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.123504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.123657 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.123862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.123862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.124156 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.124314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.124480 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.124640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.124806 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.124959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.125110 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.125284 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.125444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.125637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.125795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.125955 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.126115 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.126277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.126478 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.127143 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.127298 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.127449 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.127599 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.127763 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.127927 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.128085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.128238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.128390 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.128541 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.128701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.128853 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.129004 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.129192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.129357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.129520 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.129673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.129870 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.130041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.130201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.130441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.130610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.130807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.130967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.131119 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.131280 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.131441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.131609 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.131763 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.131921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.132085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.132247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.132402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.132563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.132716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.132866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.133025 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.133185 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.133338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.133503 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.133664 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.133817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.133976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.134139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.134300 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.134459 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.134621 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.134802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.134961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.135112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.135280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.135280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.135578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.135730 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.135880 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.136041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.136218 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.136371 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.136521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.136681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.136833 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.136998 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.137150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.137309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.137463 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.137614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.137766 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.137930 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.138093 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.138252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.138417 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.138577 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.138731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.138926 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.139088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.139249 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.139401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.139551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.139701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.139867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.140028 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.140197 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.140357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.140590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.140769 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.140933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.141092 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.141244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.141244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.141544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.141704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.141864 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.142127 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.142287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.142450 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.142601 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.142798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.142960 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.143123 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.143282 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.143434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.143592 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.143754 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.143905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.144058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.144208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.144358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.144598 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.144761 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.144921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.145081 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.145240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.145393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.145393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.145702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.145861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.146021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.146173 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.146323 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.146501 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.146655 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.146844 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.147002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.147155 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.147305 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.147470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.147629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.147800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.147953 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.148112 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.148278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.148437 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.148599 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.148757 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.148909 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.149060 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.149226 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.149386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.149538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.149688 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.149846 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.149997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.150161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.150314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.150314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.150640 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.150854 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.151023 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.151193 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.151346 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.151506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.151660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.151812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.151971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.152137 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.152290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.152442 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.152612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.152765 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.152930 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.153084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.153242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.153395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.153555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.153716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.153881 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.154034 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.154185 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.154336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.154488 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.154662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.154835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.154992 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.155143 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.155294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.155444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.155608 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.155769 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.155929 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.156089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.156241 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.156414 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.156568 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.156719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.156870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.157027 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.157182 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.157351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.157503 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.158204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.158364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.158522 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.158677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.158881 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.159045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.159197 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.159349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.159499 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.159666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.159820 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.159980 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.160132 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.160283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.160434 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.160594 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.160758 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.160923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.161082 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.161278 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.161443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.161611 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.161799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.161956 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.162107 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.162265 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.162426 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.162579 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.162730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.162933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.163096 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.163096 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.163407 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.163560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.163710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.163710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.164014 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.164166 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.164330 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.164489 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.164648 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.164811 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.164971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.165133 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.165292 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.165445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.165596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.165755 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.165907 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.166073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.166234 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.166394 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.166553 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.166706 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.166902 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167023 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167231 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167329 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167428 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167615 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.167980 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.168078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.168078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.168239 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.168332 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.168421 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.168751 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.168870 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.169086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.169187 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.169410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.169506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.169731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.169836 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.170045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.170150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.170362 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.170457 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.170669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.170800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.171020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.171187 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.171351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.171503 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.171667 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.171820 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.171972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.172140 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.172293 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.172444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.172609 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.172769 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.172930 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.173089 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.173292 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.173972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.174212 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.174368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.174519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.174670 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.174866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.175036 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.175203 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.175364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.175525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.175676 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.175676 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.175974 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.176125 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.176283 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.176443 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.176603 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.176755 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.176931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.177092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.177244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.177395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.177553 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.177706 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.177866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.178019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.178177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.178329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.178479 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.178630 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.178809 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.178990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.179150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.179302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.179454 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.179619 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.179779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.179938 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.179938 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.180243 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.180395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.180558 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.180718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.180718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.181063 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.181223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.181376 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.181542 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.181702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.181854 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.182004 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.182155 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.182312 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.182312 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.182610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.182762 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.182959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.183111 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.183282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.183436 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.183587 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.183737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.183889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.184039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.184199 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.184600 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.184757 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.184917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.185068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.185229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.185394 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.185547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.185840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.186006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.186160 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.186312 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.186473 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.186632 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.186847 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.187019 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.187172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.187347 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.187507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.187660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.187818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.187978 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.188131 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.188301 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.188461 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.188622 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.188782 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.188961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.189115 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.189280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.189444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.189596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.189840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.189998 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.190160 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.190350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.190509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.190668 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.190853 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.191013 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.191176 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.191327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.191489 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.191649 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.191801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.191960 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.192122 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.192285 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.192445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.192598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.192756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.192918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.193071 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.193222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.193414 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.193581 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.193581 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.193918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.194077 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.194228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.194380 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.194538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.194691 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.194897 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.195061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.195221 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.195383 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.195546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.195696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.195865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.196027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.196259 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.196430 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.196582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.196742 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.196910 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.197062 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.197212 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.197370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.197536 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.197701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.197861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.198013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.198164 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.198315 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.198474 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.198635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.198808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.198978 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.199131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.199282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.199443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.199614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.199766 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.199916 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.200066 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.200216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.200375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.200535 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.200535 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.200834 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.200986 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.201143 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.201305 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.201471 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.201631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.201791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.201950 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.202115 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.202269 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.202419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.202570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.202721 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.202915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.203079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.203231 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.203394 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.203561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.203713 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.203871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.204103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.204264 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.204416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.204604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.204759 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.204918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.205080 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.205233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.205383 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.205533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.205694 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.205860 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.206021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.206172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.206330 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.206483 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.206633 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.206811 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.206971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.207123 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.207284 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.207284 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.207576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.207749 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.207902 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.208056 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.208207 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.208357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.208517 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.208683 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.208837 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.208996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.209148 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.209298 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.209461 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.209624 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.209782 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.209943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.210104 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.210257 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.210417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.210578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.210738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.210943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.211107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.211267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.211429 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.211590 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.211760 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.211912 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.212064 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.212805 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.212974 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.212974 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.213275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.213442 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.213608 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.213769 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.213921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.214072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.214072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.214385 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.214550 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.214710 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.214891 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.215045 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.215045 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.215343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.215510 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.215663 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.215827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.215988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.216155 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.216318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.216478 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.216638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.216638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.216925 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.217083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.217249 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.217411 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.217562 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.217720 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.217872 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.218031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.218203 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.218365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.218527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.218687 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.218862 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.219034 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.219194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.219346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.219506 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.219506 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.219812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.219972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.220651 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.220819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.220971 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.221130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.221281 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.221446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.221600 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.221750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.221900 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.222051 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.222200 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.222403 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.222561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.222723 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.222917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.222917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 07:07:32.223219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.223219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.223219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.223673 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.223983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.224323 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.224652 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.225147 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.225588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 07:07:32.225839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 07:07:32.288402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO dbcounter [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Registered counter for database nova_api Jul 01 07:07:32.293518 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO dbcounter [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Registered counter for database nova_api Jul 01 07:07:32.308761 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_db.sqlalchemy.engines [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 07:07:32.313424 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_db.sqlalchemy.engines [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 07:07:32.316416 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writer thread running {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 07:07:32.320706 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writer thread running {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 07:07:32.371885 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.context [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a747ebb4-7590-42b4-a916-aba82f80a3cf(cell1) {{(pid=117835) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 07:07:32.376021 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:07:32.377285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.context [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a747ebb4-7590-42b4-a916-aba82f80a3cf(cell1) {{(pid=117836) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 07:07:32.378180 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:07:32.379016 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:07:32.381004 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:07:32.381443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:07:32.383014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO dbcounter [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Registered counter for database nova_cell0 Jul 01 07:07:32.383124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:07:32.383816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:07:32.385893 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:07:32.387024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO dbcounter [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Registered counter for database nova_cell1 Jul 01 07:07:32.387950 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO dbcounter [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Registered counter for database nova_cell0 Jul 01 07:07:32.392698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO dbcounter [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Registered counter for database nova_cell1 Jul 01 07:07:32.394548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_db.sqlalchemy.engines [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 07:07:32.400296 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writer thread running {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 07:07:32.400468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_db.sqlalchemy.engines [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 07:07:32.403677 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_db.sqlalchemy.engines [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 07:07:32.406591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writer thread running {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 07:07:32.407430 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_db.sqlalchemy.engines [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 07:07:32.546954 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writer thread running {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 07:07:32.551242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writer thread running {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 07:07:32.558389 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO dbcounter [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Registered counter for database nova_cell0 Jul 01 07:07:32.560196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO dbcounter [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Registered counter for database nova_cell0 Jul 01 07:07:32.566281 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_db.sqlalchemy.engines [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 07:07:32.572796 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_db.sqlalchemy.engines [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 07:07:32.576104 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writer thread running {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 07:07:32.577851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writer thread running {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 07:07:32.895877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: WARNING keystonemiddleware.auth_token [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 07:07:32.898310 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: WARNING keystonemiddleware.auth_token [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 07:07:32.903528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: WARNING keystonemiddleware.auth_token [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 07:07:32.905618 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: WARNING keystonemiddleware.auth_token [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 07:07:33.248256 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: WARNING keystonemiddleware.auth_token [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 07:07:33.250073 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: WARNING keystonemiddleware.auth_token [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 07:07:33.254287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: WARNING keystonemiddleware.auth_token [None req-bd528436-f524-4324-b7b0-e67a9fced24d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 07:07:33.256116 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: WARNING keystonemiddleware.auth_token [None req-f27fb53f-8aa4-47b5-a71b-be9cdb000440 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 07:07:33.259684 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea058cd9c0 pid: 117835 (default app) Jul 01 07:07:33.261438 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea058cd9c0 pid: 117836 (default app) Jul 01 07:08:14.297135 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:14.298022 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:14.298947 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:14.300237 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:15.559036 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-186211a5-e388-4be0-aaa8-1c84be61c5cc tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Action: 'create', calling method: .version_select at 0x7f2c4c3b3430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-308780267"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:17.702377 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-186211a5-e388-4be0-aaa8-1c84be61c5cc tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.421511 Jul 01 07:08:17.703331 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1154 bytes} [Fri Jul 1 07:08:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3424 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 07:08:17.717894 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:17.719083 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:17.719829 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:17.720733 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:18.072535 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-94f54fff-970a-496b-bc30-3fb9e2ee5254 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c46af70>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:18.683093 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-94f54fff-970a-496b-bc30-3fb9e2ee5254 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 200 len: 344 microversion: 2.1 time: 0.970096 Jul 01 07:08:18.692442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:17 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 344 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:19.699051 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-025649ab-d793-4bf3-971a-318b80d88e91 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c278310>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:19.830679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-025649ab-d793-4bf3-971a-318b80d88e91 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 200 len: 345 microversion: 2.1 time: 0.136120 Jul 01 07:08:19.831549 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:19 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:19.844802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-78fe2c17-12f3-4f58-a64a-3fb5f67dc0c3 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Action: 'create', calling method: .version_select at 0x7f2c4c27a1f0>, body: {"snapshot": {"volume_id": "f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-173272520"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:20.405573 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-78fe2c17-12f3-4f58-a64a-3fb5f67dc0c3 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.565537 Jul 01 07:08:20.406548 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 2/4] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Jul 1 07:08:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:20.433220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fea2dbdb-3e11-492b-a97d-fb1181abe888 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c278430>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:20.537917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fea2dbdb-3e11-492b-a97d-fb1181abe888 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.124551 Jul 01 07:08:20.538643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:20 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:20.550082 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f43676bd-60d5-4d36-8fa4-5bc5872ba798 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c27a8b0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:20.619178 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f43676bd-60d5-4d36-8fa4-5bc5872ba798 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.073135 Jul 01 07:08:20.620045 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jul 1 07:08:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:20.632896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fd9ded94-2981-447f-9ecd-542825cbd761 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c278af0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:20.694312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fd9ded94-2981-447f-9ecd-542825cbd761 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.066368 Jul 01 07:08:20.695935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:20 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:21.711851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-569696bd-c932-4693-a957-2b3fec2e44df tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c27aee0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:21.818696 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-569696bd-c932-4693-a957-2b3fec2e44df tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.113334 Jul 01 07:08:21.819660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:21 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:22.832378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8600a909-c5ee-4a9e-a9bd-fdab6a313918 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c2951f0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:22.881201 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8600a909-c5ee-4a9e-a9bd-fdab6a313918 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.053932 Jul 01 07:08:22.882026 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 5/9] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:22 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:23.894164 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9c5a0f93-426c-46be-a66e-8b35e82dbd8a tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c28a670>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:23.952961 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9c5a0f93-426c-46be-a66e-8b35e82dbd8a tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.064139 Jul 01 07:08:23.954035 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 5/10] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:23 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:24.967203 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-06bc945f-abc2-45dd-a3c4-ae674ec25d8e tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c278c10>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:25.026652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-06bc945f-abc2-45dd-a3c4-ae674ec25d8e tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.064200 Jul 01 07:08:25.027242 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 6/11] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:24 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:26.040395 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-08ad5a36-9fd6-4a24-962e-8466d650d241 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c27a3a0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:26.119693 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-08ad5a36-9fd6-4a24-962e-8466d650d241 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.085877 Jul 01 07:08:26.120595 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:26 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:08:27.131878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2ce3dd01-a457-490f-b75d-1928589e11fd tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c2781f0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:27.208734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2ce3dd01-a457-490f-b75d-1928589e11fd tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.079730 Jul 01 07:08:27.210244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:27 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:28.221791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3c953e85-979a-4bf1-951e-160e74af343d tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c27a8b0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:28.602965 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1176086409", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "networks": [{"uuid": "afef6e7b-a621-4fd0-bf68-fef7efe341b1"}]}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:28.758507 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3c953e85-979a-4bf1-951e-160e74af343d tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.541153 Jul 01 07:08:28.764130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 7/14] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:28 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:28.883532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] validate_networks() for [('afef6e7b-a621-4fd0-bf68-fef7efe341b1', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:08:29.773739 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d13be8af-9e3c-4255-8c92-21692b36a134 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c28a9d0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:29.882494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d13be8af-9e3c-4255-8c92-21692b36a134 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.115057 Jul 01 07:08:29.887772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 8/15] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:29 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:30.499298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:08:30.499900 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:08:30.500232 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:08:30.500646 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:08:30.501067 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:08:30.528552 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:30.529003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:30.529808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:30.530245 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:30.629488 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Getting quotas for project fa10fec302f0464ead56582b81409441. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:08:30.641519 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Getting quotas for user ec800c1fb0e74f2caabab848db0432db and project fa10fec302f0464ead56582b81409441. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:08:30.658659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:08:30.666261 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:08:30.808097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-40913ab5-f8a8-4fb3-b71b-fb5eb6cbe794 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.520681 Jul 01 07:08:30.809985 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 8/16] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:08:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 07:08:30.822360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3f3b4968-1b32-48f5-9caf-1ef3f29a0a4f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:30.824911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3f3b4968-1b32-48f5-9caf-1ef3f29a0a4f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:30.899809 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7b817134-df92-4ee4-a184-1108287456b0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c183e50>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:30.983662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7b817134-df92-4ee4-a184-1108287456b0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.087955 Jul 01 07:08:30.984888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 9/17] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:30 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:08:31.041612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3f3b4968-1b32-48f5-9caf-1ef3f29a0a4f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:31.076464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3f3b4968-1b32-48f5-9caf-1ef3f29a0a4f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1215 microversion: 2.1 time: 0.258202 Jul 01 07:08:31.079463 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 9/18] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:30 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:31.877601 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-797ad20d-dfc1-4b0c-b83e-909f4cbf9b14 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'create', calling method: .version_select at 0x7f2c4b121550>, body: {"keypair": {"name": "tempest-keypair-1501261960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNQpDzCpyaF/fDh5PLzXYLZ4SABlQ9EukYGbDHaOlGVmeyyjGiWzLfhPALZxeXIL2REXdqTq1hAdTYEelvOUX2uyDFI67MjPlRwqmXM8IyBq0nkiS9lMwguSYIIccwwzQ=="}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:31.948004 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-797ad20d-dfc1-4b0c-b83e-909f4cbf9b14 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Getting quotas for project c0aec4ac096f4f30b7c357db043925fd. Resources: {'key_pairs'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:08:31.964168 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-797ad20d-dfc1-4b0c-b83e-909f4cbf9b14 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Getting quotas for user 0e8bf7bbabc4432fa88002ea5c1dce4c and project c0aec4ac096f4f30b7c357db043925fd. Resources: {'key_pairs'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:08:32.010642 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9de17883-8b3b-4b29-a9f8-2e73171267f6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: .version_select at 0x7f2c4c28a790>, body: {"keypair": {"name": "tempest-keypair-438463469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvb6CShJIJEfZuJJHA/aQrYZGe9sTEy+r4Uau6jQ3cBjyB/Bm9lNmooNEw+edOTCA1QU2DKRTMzqgwLCYRJCyU2FKkEKUJoJAejsZZIpMDyFt9UPlCdsdwim7g/dr2PcQ=="}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:32.044378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-797ad20d-dfc1-4b0c-b83e-909f4cbf9b14 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.337774 Jul 01 07:08:32.045013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 10/19] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jul 1 07:08:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 339 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 07:08:32.056263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7d1ab5ec-6fad-4def-81d3-02b03c5f44df tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4b1375e0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:32.120538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7d1ab5ec-6fad-4def-81d3-02b03c5f44df tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 287 microversion: 2.1 time: 0.067980 Jul 01 07:08:32.121313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-9de17883-8b3b-4b29-a9f8-2e73171267f6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for project dc0aa7206a704d45a610dccc24ec8767. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:08:32.133655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 11/20] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:32 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:32.145464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-9de17883-8b3b-4b29-a9f8-2e73171267f6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for user df44f27783d34370ad83470ffde558a8 and project dc0aa7206a704d45a610dccc24ec8767. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:08:32.257302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-506728808", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:32.288784 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9de17883-8b3b-4b29-a9f8-2e73171267f6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.536244 Jul 01 07:08:32.295241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 10/21] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:08:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:32.310878 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9186d64f-be84-44d8-9e9f-1e450fd64019 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:32.321630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9186d64f-be84-44d8-9e9f-1e450fd64019 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:32.441693 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] validate_networks() for [('736f268f-40b8-4ff4-91ad-a9795eb5f897', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:08:32.500548 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9186d64f-be84-44d8-9e9f-1e450fd64019 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:32.512410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9186d64f-be84-44d8-9e9f-1e450fd64019 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1215 microversion: 2.1 time: 0.219601 Jul 01 07:08:32.515629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 11/22] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:32 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:32.528027 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-73a6afe0-461e-4c29-a570-bf0f8cd648eb tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4c1d6f70>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:32.708096 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-73a6afe0-461e-4c29-a570-bf0f8cd648eb tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 202 len: 0 microversion: 2.1 time: 0.187927 Jul 01 07:08:32.708671 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jul 1 07:08:32 2022] DELETE /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:08:32.718915 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6de17b16-93dd-49d5-8e49-05dacfa1dfcc tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4b9633a0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:32.778891 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6de17b16-93dd-49d5-8e49-05dacfa1dfcc tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.064572 Jul 01 07:08:32.779773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:32 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:33.532761 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a055787f-ba00-4bcb-a4ec-6af204675b90 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:33.534324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a055787f-ba00-4bcb-a4ec-6af204675b90 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:33.546250 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a055787f-ba00-4bcb-a4ec-6af204675b90 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:33.559963 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a055787f-ba00-4bcb-a4ec-6af204675b90 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:33.562745 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a055787f-ba00-4bcb-a4ec-6af204675b90 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:33.564789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a055787f-ba00-4bcb-a4ec-6af204675b90 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:33.574220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:08:33.574732 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:08:33.575405 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:08:33.575987 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:08:33.576553 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:08:33.590489 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:33.598678 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:33.600530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:33.601731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:33.644927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Getting quotas for project d94c1c234804421487c49cc9df6ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:08:33.652265 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Getting quotas for user 4549c33736bc413a87460db0c43f5768 and project d94c1c234804421487c49cc9df6ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:08:33.670089 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:08:33.672684 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:08:33.738816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2d8d927d-2189-433e-9d93-58d6db128b5e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.598752 Jul 01 07:08:33.739738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 12/25] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:08:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:08:33.753516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-36640119-3f3a-4347-aa27-35069c506715 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:33.754549 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-36640119-3f3a-4347-aa27-35069c506715 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:34.022869 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-36640119-3f3a-4347-aa27-35069c506715 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:34.055080 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-36640119-3f3a-4347-aa27-35069c506715 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1221 microversion: 2.1 time: 0.308146 Jul 01 07:08:34.065642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:33 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1221 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:08:34.083918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b60587e8-3b45-4380-b268-be8d6ba03c55 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4b1375e0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:34.095927 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a055787f-ba00-4bcb-a4ec-6af204675b90 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:34.114825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a055787f-ba00-4bcb-a4ec-6af204675b90 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1219 microversion: 2.1 time: 0.587144 Jul 01 07:08:34.125784 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:33 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1219 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:08:34.143694 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b60587e8-3b45-4380-b268-be8d6ba03c55 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.075511 Jul 01 07:08:34.144274 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 14/28] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:34 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:34.164565 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-838553084", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:34.352698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] validate_networks() for [('736f268f-40b8-4ff4-91ad-a9795eb5f897', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:08:35.132933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f3d82ea0-0d26-4947-86a8-31376eb96fa8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:35.133779 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f3d82ea0-0d26-4947-86a8-31376eb96fa8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:35.152263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f3d82ea0-0d26-4947-86a8-31376eb96fa8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:35.152723 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f3d82ea0-0d26-4947-86a8-31376eb96fa8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:35.153501 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f3d82ea0-0d26-4947-86a8-31376eb96fa8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:35.155595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f3d82ea0-0d26-4947-86a8-31376eb96fa8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:35.656298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f3d82ea0-0d26-4947-86a8-31376eb96fa8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:35.677130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f3d82ea0-0d26-4947-86a8-31376eb96fa8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1219 microversion: 2.1 time: 0.546967 Jul 01 07:08:35.677911 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 15/29] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:35 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1219 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:35.690924 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5d59de02-4ae9-4de3-9dfc-911b489698ba tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a8e94c0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:35.762304 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5d59de02-4ae9-4de3-9dfc-911b489698ba tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.082403 Jul 01 07:08:35.766663 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 16/30] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:35 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:35.816470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1883168537", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f720862-6697-4120-b152-2a0712a988e8"}], "security_groups": [{"name": "tempest-securitygroup--265312546"}], "key_name": "tempest-keypair-438463469", "user_data": "}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:36.118049 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] validate_networks() for [('2f720862-6697-4120-b152-2a0712a988e8', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:08:36.448716 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:08:36.449273 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:08:36.449611 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:08:36.450031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:08:36.450460 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:08:36.478555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:36.480166 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:36.481207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:36.481808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:36.532680 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Getting quotas for project d94c1c234804421487c49cc9df6ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:08:36.537679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Getting quotas for user 4549c33736bc413a87460db0c43f5768 and project d94c1c234804421487c49cc9df6ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:08:36.554149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:08:36.561675 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:08:36.768234 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-584242ef-0049-4dfc-93d6-7dacec34cd11 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.607829 Jul 01 07:08:36.770887 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 15/31] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:08:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:08:36.790389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ee185038-3e17-4277-ac4e-38254cba50e9 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:36.797006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ee185038-3e17-4277-ac4e-38254cba50e9 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:36.832946 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee185038-3e17-4277-ac4e-38254cba50e9 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:36.837808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee185038-3e17-4277-ac4e-38254cba50e9 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:36.839808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee185038-3e17-4277-ac4e-38254cba50e9 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:36.843983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee185038-3e17-4277-ac4e-38254cba50e9 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:37.467809 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ee185038-3e17-4277-ac4e-38254cba50e9 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:37.482412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ee185038-3e17-4277-ac4e-38254cba50e9 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1285 microversion: 2.1 time: 0.708123 Jul 01 07:08:37.496736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 16/32] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:36 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1285 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:37.507475 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4cd882a1-a167-43e3-b4b3-1ee4bbc3ce25 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a8281f0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:37.567000 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4cd882a1-a167-43e3-b4b3-1ee4bbc3ce25 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 200 len: 286 microversion: 2.1 time: 0.067085 Jul 01 07:08:37.569646 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:37 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:37.577011 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1fc8df44-e378-4124-be53-c5a466183361 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:37.578793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1fc8df44-e378-4124-be53-c5a466183361 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:37.903248 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1fc8df44-e378-4124-be53-c5a466183361 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:37.920573 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1fc8df44-e378-4124-be53-c5a466183361 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1221 microversion: 2.1 time: 0.347063 Jul 01 07:08:37.921996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:37 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1221 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:37.929735 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1022192222", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15f0fe42-8be6-4370-8ef5-d4c04f6ba242"}], "security_groups": [{"name": "tempest-securitygroup--1972527253"}], "key_name": "tempest-keypair-1501261960", "user_data": "}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:38.097606 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:08:38.098070 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:08:38.098428 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:08:38.098944 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:08:38.099466 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:08:38.131258 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:38.138966 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:38.146259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:38.146259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:38.153346 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] validate_networks() for [('15f0fe42-8be6-4370-8ef5-d4c04f6ba242', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:08:38.239902 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for project dc0aa7206a704d45a610dccc24ec8767. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:08:38.253090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for user df44f27783d34370ad83470ffde558a8 and project dc0aa7206a704d45a610dccc24ec8767. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:08:38.285608 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:08:38.287801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:08:38.385534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ba9092d4-333f-43f4-add2-673e5531a5b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.574547 Jul 01 07:08:38.386227 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 17/35] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:08:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:08:38.408862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-cab2638a-dba5-4dd8-bc70-c640968f3da8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:38.409698 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-cab2638a-dba5-4dd8-bc70-c640968f3da8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:39.018326 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-cab2638a-dba5-4dd8-bc70-c640968f3da8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:39.032953 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-cab2638a-dba5-4dd8-bc70-c640968f3da8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1241 microversion: 2.1 time: 0.624719 Jul 01 07:08:39.039196 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 18/36] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:38 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1241 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:39.069315 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8ba8fbda-420b-4bfd-a6f1-d94c8dab1dc0 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:39.072938 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8ba8fbda-420b-4bfd-a6f1-d94c8dab1dc0 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:39.130515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ba8fbda-420b-4bfd-a6f1-d94c8dab1dc0 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:39.131296 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ba8fbda-420b-4bfd-a6f1-d94c8dab1dc0 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:39.138460 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ba8fbda-420b-4bfd-a6f1-d94c8dab1dc0 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:39.142166 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ba8fbda-420b-4bfd-a6f1-d94c8dab1dc0 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:40.466703 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8ba8fbda-420b-4bfd-a6f1-d94c8dab1dc0 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:40.474939 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8ba8fbda-420b-4bfd-a6f1-d94c8dab1dc0 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 1.432055 Jul 01 07:08:40.490939 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 19/37] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:39 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:40.495054 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a9abdb5e-ce0b-4be3-bc65-86a997ea7bb0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a896f70>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:40.580464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-a9abdb5e-ce0b-4be3-bc65-86a997ea7bb0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] HTTP exception thrown: Snapshot 3ba38eec-2b65-4a21-a87a-2e99b942fe40 could not be found. Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a9abdb5e-ce0b-4be3-bc65-86a997ea7bb0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Request method failure captured: Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 HTTP/1.1 Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1eju-sAHUN5eO_qjAuXkLX2Mwk2SK6Yap6wba1WndPBnBN7mpIifzDXkO-lOhkPabz8WrMcF46QZeEAGS9dKR4ShqTt15osNpfTIxLIgPSCIxRG048jqTDsjOxC1O0IHRuWoRZKNZrEDC2_lbIvEQdzPqU_U3iuY9CVNral0EnDoE Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: d1aca28518cc4f5782c74f34479175f1 Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:08:40.584704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d1aca28518cc4f5782c74f34479175f1"}]}] Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: d1aca28518cc4f5782c74f34479175f1 Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-VolumesSnapshotsTestJSON-695101544-project Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: f9c4512401034796abda50f2fda51887 Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-695101544-project Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Snapshot 3ba38eec-2b65-4a21-a87a-2e99b942fe40 could not be found. Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '3ba38eec-2b65-4a21-a87a-2e99b942fe40'} Jul 01 07:08:40.586189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3ba38eec-2b65-4a21-a87a-2e99b942fe40 could not be found. (HTTP 404) (Request-ID: req-bfa14159-ed80-4419-8674-65f77a56564e) Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:40.587092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:08:40.588079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3ba38eec-2b65-4a21-a87a-2e99b942fe40 could not be found. Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 01 07:08:40.589097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3ba38eec-2b65-4a21-a87a-2e99b942fe40 could not be found. Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3ba38eec-2b65-4a21-a87a-2e99b942fe40 could not be found. Jul 01 07:08:40.590107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:40.592162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a9abdb5e-ce0b-4be3-bc65-86a997ea7bb0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Returning 404 to user: Snapshot 3ba38eec-2b65-4a21-a87a-2e99b942fe40 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:08:40.593788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a9abdb5e-ce0b-4be3-bc65-86a997ea7bb0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40" status: 404 len: 111 microversion: 2.1 time: 0.108383 Jul 01 07:08:40.596941 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jul 1 07:08:40 2022] GET /compute/v2.1/os-snapshots/3ba38eec-2b65-4a21-a87a-2e99b942fe40 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:08:40.614981 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f53029b5-c029-4156-98a4-22a7428081dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:40.615650 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f53029b5-c029-4156-98a4-22a7428081dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:40.628698 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f53029b5-c029-4156-98a4-22a7428081dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:40.629188 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f53029b5-c029-4156-98a4-22a7428081dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:40.643526 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f53029b5-c029-4156-98a4-22a7428081dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:40.643993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f53029b5-c029-4156-98a4-22a7428081dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:40.910515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f53029b5-c029-4156-98a4-22a7428081dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:40.918471 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f53029b5-c029-4156-98a4-22a7428081dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1279 microversion: 2.1 time: 0.317855 Jul 01 07:08:40.923220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:40 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1279 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:40.935675 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3d03c4ab-d94e-4672-8976-f38f0280a660 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:40.936592 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3d03c4ab-d94e-4672-8976-f38f0280a660 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:40.954956 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3d03c4ab-d94e-4672-8976-f38f0280a660 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:40.955718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3d03c4ab-d94e-4672-8976-f38f0280a660 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:40.956649 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3d03c4ab-d94e-4672-8976-f38f0280a660 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:40.957228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3d03c4ab-d94e-4672-8976-f38f0280a660 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:41.153585 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3d03c4ab-d94e-4672-8976-f38f0280a660 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:41.163497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3d03c4ab-d94e-4672-8976-f38f0280a660 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.238981 Jul 01 07:08:41.186302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 22/40] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:40 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:41.196465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b3d612ed-1531-4b92-a5b0-b90552b0e5b9 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a7adee0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:41.234541 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:08:41.235237 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:08:41.236122 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:08:41.236858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:08:41.237444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:08:41.256404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:41.258816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:41.260053 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:41.261317 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:41.345595 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Getting quotas for project c0aec4ac096f4f30b7c357db043925fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:08:41.354677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b3d612ed-1531-4b92-a5b0-b90552b0e5b9 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 202 len: 0 microversion: 2.1 time: 0.163616 Jul 01 07:08:41.355517 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 23/41] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:08:41 2022] DELETE /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:08:41.361740 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Getting quotas for user 0e8bf7bbabc4432fa88002ea5c1dce4c and project c0aec4ac096f4f30b7c357db043925fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:08:41.363857 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-61c9c907-bb26-448b-b4fc-3544f9c8dcb5 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a7adb80>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:41.408895 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:08:41.414113 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:08:41.530160 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-61c9c907-bb26-448b-b4fc-3544f9c8dcb5 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 200 len: 344 microversion: 2.1 time: 0.169847 Jul 01 07:08:41.531108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 24/42] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:41 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 344 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:08:41.538120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-98a08b33-45be-490a-b11c-f5d9050d5e91 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:41.538120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-98a08b33-45be-490a-b11c-f5d9050d5e91 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:41.571822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-98a08b33-45be-490a-b11c-f5d9050d5e91 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:41.572284 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-98a08b33-45be-490a-b11c-f5d9050d5e91 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:41.573086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-98a08b33-45be-490a-b11c-f5d9050d5e91 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:41.573527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-98a08b33-45be-490a-b11c-f5d9050d5e91 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:41.614173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0b87c63e-4c3c-438d-8965-e374215fd279 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.689343 Jul 01 07:08:41.621841 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 19/43] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jul 1 07:08:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 3695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 07:08:41.646672 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-787a66ab-b086-4bf6-a2eb-2e0916fbb98c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:41.647914 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-787a66ab-b086-4bf6-a2eb-2e0916fbb98c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:42.104647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-787a66ab-b086-4bf6-a2eb-2e0916fbb98c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:42.124546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-787a66ab-b086-4bf6-a2eb-2e0916fbb98c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:42.126804 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-787a66ab-b086-4bf6-a2eb-2e0916fbb98c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:42.128540 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-787a66ab-b086-4bf6-a2eb-2e0916fbb98c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1282 microversion: 2.20 time: 0.505370 Jul 01 07:08:42.129264 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 20/44] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:41 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1282 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:42.134750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-17363416-773a-4590-9956-5e1b4358bd79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:42.135230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-17363416-773a-4590-9956-5e1b4358bd79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:42.148988 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17363416-773a-4590-9956-5e1b4358bd79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:42.149452 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17363416-773a-4590-9956-5e1b4358bd79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:42.154467 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17363416-773a-4590-9956-5e1b4358bd79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:42.155146 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17363416-773a-4590-9956-5e1b4358bd79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:42.471037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-98a08b33-45be-490a-b11c-f5d9050d5e91 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:42.477869 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-17363416-773a-4590-9956-5e1b4358bd79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:42.480961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-98a08b33-45be-490a-b11c-f5d9050d5e91 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.948812 Jul 01 07:08:42.486502 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-17363416-773a-4590-9956-5e1b4358bd79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1279 microversion: 2.1 time: 0.355954 Jul 01 07:08:42.487338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 25/45] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:41 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:42.490143 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 21/46] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:42 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1279 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:42.495087 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-18a1e97e-852f-4ebb-883e-fcc1b52dc7ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:42.495896 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-18a1e97e-852f-4ebb-883e-fcc1b52dc7ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:42.510427 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-18a1e97e-852f-4ebb-883e-fcc1b52dc7ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:42.510911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-18a1e97e-852f-4ebb-883e-fcc1b52dc7ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:42.523040 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-18a1e97e-852f-4ebb-883e-fcc1b52dc7ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:42.523499 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-18a1e97e-852f-4ebb-883e-fcc1b52dc7ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:42.584630 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-e0379d22-381e-404b-ab3f-66046ac7a243 req-a571c426-1f79-4a59-9a9a-bd22ef8f08f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc68164-9c81-4c8c-92a9-7845381bbff8", "tag": "8e8b676a-7f20-4a8f-bf53-71349dc3312b"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:42.598698 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-e0379d22-381e-404b-ab3f-66046ac7a243 req-a571c426-1f79-4a59-9a9a-bd22ef8f08f9 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:42.599412 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-e0379d22-381e-404b-ab3f-66046ac7a243 req-a571c426-1f79-4a59-9a9a-bd22ef8f08f9 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:42.611835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-18a1e97e-852f-4ebb-883e-fcc1b52dc7ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:42.624872 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-18a1e97e-852f-4ebb-883e-fcc1b52dc7ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.131637 Jul 01 07:08:42.627064 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-e0379d22-381e-404b-ab3f-66046ac7a243 req-a571c426-1f79-4a59-9a9a-bd22ef8f08f9 service nova] Creating event network-changed:8e8b676a-7f20-4a8f-bf53-71349dc3312b for instance afc68164-9c81-4c8c-92a9-7845381bbff8 on hv-cinder-80721 Jul 01 07:08:42.636092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-e0379d22-381e-404b-ab3f-66046ac7a243 req-a571c426-1f79-4a59-9a9a-bd22ef8f08f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 07:08:42.636266 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 22/47] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:42 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:42.636392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0f81b3f-a51a-4c29-9310-a74aea586bc3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:42.636392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0f81b3f-a51a-4c29-9310-a74aea586bc3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:42.636392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0f81b3f-a51a-4c29-9310-a74aea586bc3 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:42.636392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0f81b3f-a51a-4c29-9310-a74aea586bc3 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:42.636702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8e57fb9a-0552-43a1-bf80-579801616ca0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a843550>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:42.642391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.compute.rpcapi [None req-b0f81b3f-a51a-4c29-9310-a74aea586bc3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 07:08:42.643458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0f81b3f-a51a-4c29-9310-a74aea586bc3 None None] Releasing lock "compute-rpcapi-router" {{(pid=117835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 07:08:42.691073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b0f81b3f-a51a-4c29-9310-a74aea586bc3 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202030 Jul 01 07:08:42.691637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 26/48] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:42.739291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8e57fb9a-0552-43a1-bf80-579801616ca0 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 200 len: 344 microversion: 2.1 time: 0.109282 Jul 01 07:08:42.745116 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 23/49] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:42 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:43.150476 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:43.152032 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:43.162488 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:43.164147 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:43.166162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:43.166607 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:43.260262 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:43.272358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:43.275386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:43.277126 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a2631ba6-89cf-40c2-a361-121fffb49cf8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.131492 Jul 01 07:08:43.278238 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 27/50] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:43 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:43.503630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0c01d1fa-aa22-4d4d-8f6b-ee27e4861a5a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:43.504287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0c01d1fa-aa22-4d4d-8f6b-ee27e4861a5a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:43.516913 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-70469804-d902-400a-add2-d1b6b635e5db tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:43.517468 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-70469804-d902-400a-add2-d1b6b635e5db tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:43.525154 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0c01d1fa-aa22-4d4d-8f6b-ee27e4861a5a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:43.525706 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0c01d1fa-aa22-4d4d-8f6b-ee27e4861a5a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:43.526628 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0c01d1fa-aa22-4d4d-8f6b-ee27e4861a5a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:43.527171 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0c01d1fa-aa22-4d4d-8f6b-ee27e4861a5a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:43.543386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70469804-d902-400a-add2-d1b6b635e5db tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:43.544113 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70469804-d902-400a-add2-d1b6b635e5db tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:43.545204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70469804-d902-400a-add2-d1b6b635e5db tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:43.545720 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70469804-d902-400a-add2-d1b6b635e5db tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:43.803445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0c01d1fa-aa22-4d4d-8f6b-ee27e4861a5a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:43.805278 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-70469804-d902-400a-add2-d1b6b635e5db tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:43.812609 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0c01d1fa-aa22-4d4d-8f6b-ee27e4861a5a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.312679 Jul 01 07:08:43.813616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 24/51] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:43 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:43.818614 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c0d7f42b-5979-46e3-bf3f-577872439857 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:43.819277 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c0d7f42b-5979-46e3-bf3f-577872439857 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:43.822827 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-70469804-d902-400a-add2-d1b6b635e5db tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.301274 Jul 01 07:08:43.823431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 28/52] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:43 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:43.826228 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c0d7f42b-5979-46e3-bf3f-577872439857 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:43.826684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c0d7f42b-5979-46e3-bf3f-577872439857 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:43.827999 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c0d7f42b-5979-46e3-bf3f-577872439857 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:43.828540 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c0d7f42b-5979-46e3-bf3f-577872439857 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:43.829169 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-85b4384e-aee8-4ea7-9eab-3b1dbee7f894 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a7ad700>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:43.900523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-85b4384e-aee8-4ea7-9eab-3b1dbee7f894 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 200 len: 344 microversion: 2.1 time: 0.075835 Jul 01 07:08:43.901168 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 29/53] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:43 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:43.925235 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c0d7f42b-5979-46e3-bf3f-577872439857 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:43.933299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c0d7f42b-5979-46e3-bf3f-577872439857 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.118398 Jul 01 07:08:43.933983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 25/54] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:43 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:44.296223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:44.296842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:44.303778 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:44.304276 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:44.305031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:44.305464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:44.367090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:44.375341 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:44.376847 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:44.377948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0714b22f-4424-4c77-ad35-3430795d5b54 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.085977 Jul 01 07:08:44.378500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 30/55] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:44 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:08:44.829244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8f8fb1cb-2ab6-4d02-901b-159cf286b8eb tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:44.829853 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8f8fb1cb-2ab6-4d02-901b-159cf286b8eb tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:44.835926 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8f8fb1cb-2ab6-4d02-901b-159cf286b8eb tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:44.836387 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8f8fb1cb-2ab6-4d02-901b-159cf286b8eb tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:44.837230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8f8fb1cb-2ab6-4d02-901b-159cf286b8eb tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:44.837670 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8f8fb1cb-2ab6-4d02-901b-159cf286b8eb tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:44.839439 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b2fdff23-e365-404d-9b02-c7e3b54d524b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:44.840057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b2fdff23-e365-404d-9b02-c7e3b54d524b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:44.845945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b2fdff23-e365-404d-9b02-c7e3b54d524b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:44.846406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b2fdff23-e365-404d-9b02-c7e3b54d524b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:44.847206 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b2fdff23-e365-404d-9b02-c7e3b54d524b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:44.847637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b2fdff23-e365-404d-9b02-c7e3b54d524b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:45.038826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8f8fb1cb-2ab6-4d02-901b-159cf286b8eb tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:45.041829 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b2fdff23-e365-404d-9b02-c7e3b54d524b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:45.047143 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8f8fb1cb-2ab6-4d02-901b-159cf286b8eb tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.221703 Jul 01 07:08:45.047800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 26/56] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:44 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:45.049757 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b2fdff23-e365-404d-9b02-c7e3b54d524b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.214064 Jul 01 07:08:45.050578 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 31/57] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:44 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:08:45.053569 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d8265088-22ed-4c54-82f5-6a98dff0fbeb tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a8439d0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:45.055327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d81ff738-b336-4230-b491-8df51f2d2e67 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:45.055939 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d81ff738-b336-4230-b491-8df51f2d2e67 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:45.062343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d81ff738-b336-4230-b491-8df51f2d2e67 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:45.062622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d81ff738-b336-4230-b491-8df51f2d2e67 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:45.063404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d81ff738-b336-4230-b491-8df51f2d2e67 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:45.063839 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d81ff738-b336-4230-b491-8df51f2d2e67 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:45.100916 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d8265088-22ed-4c54-82f5-6a98dff0fbeb tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 200 len: 344 microversion: 2.1 time: 0.051878 Jul 01 07:08:45.101488 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 27/58] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:45 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:45.127274 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d81ff738-b336-4230-b491-8df51f2d2e67 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:45.134710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d81ff738-b336-4230-b491-8df51f2d2e67 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.083092 Jul 01 07:08:45.135287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 32/59] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:45 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:45.398024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:45.398896 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:45.411799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:45.412928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:45.422557 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:45.423046 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:45.518191 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:45.527234 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:45.528861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:45.530063 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c891f873-b919-4316-91a9-88d057b6e04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.137091 Jul 01 07:08:45.531916 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 28/60] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:45 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:46.064728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aa5976de-8caf-43cf-964e-fbad1094a3ff tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:46.065330 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-aa5976de-8caf-43cf-964e-fbad1094a3ff tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:46.066923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0da93a51-da0c-4151-a631-7c2d1be6f26f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:46.067535 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0da93a51-da0c-4151-a631-7c2d1be6f26f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:46.072010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa5976de-8caf-43cf-964e-fbad1094a3ff tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:46.072456 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa5976de-8caf-43cf-964e-fbad1094a3ff tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:46.073211 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa5976de-8caf-43cf-964e-fbad1094a3ff tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:46.073360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0da93a51-da0c-4151-a631-7c2d1be6f26f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:46.073642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa5976de-8caf-43cf-964e-fbad1094a3ff tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:46.073806 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0da93a51-da0c-4151-a631-7c2d1be6f26f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:46.074559 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0da93a51-da0c-4151-a631-7c2d1be6f26f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:46.075018 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0da93a51-da0c-4151-a631-7c2d1be6f26f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:46.289626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aa5976de-8caf-43cf-964e-fbad1094a3ff tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:46.298542 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-aa5976de-8caf-43cf-964e-fbad1094a3ff tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.238155 Jul 01 07:08:46.299144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 33/61] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:46 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:46.303769 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-95f58c61-d97e-4aae-8de4-83402affdaba tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a877e50>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:46.304417 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0da93a51-da0c-4151-a631-7c2d1be6f26f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:46.314358 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0da93a51-da0c-4151-a631-7c2d1be6f26f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.251212 Jul 01 07:08:46.314964 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 29/62] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:46 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:08:46.319476 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b281b55f-e4b6-41b8-8dcd-e48e878c7013 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:46.320562 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b281b55f-e4b6-41b8-8dcd-e48e878c7013 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:46.328414 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b281b55f-e4b6-41b8-8dcd-e48e878c7013 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:46.329082 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b281b55f-e4b6-41b8-8dcd-e48e878c7013 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:46.330017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b281b55f-e4b6-41b8-8dcd-e48e878c7013 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:46.330618 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b281b55f-e4b6-41b8-8dcd-e48e878c7013 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:46.376657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-95f58c61-d97e-4aae-8de4-83402affdaba tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 200 len: 344 microversion: 2.1 time: 0.076272 Jul 01 07:08:46.377214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 34/63] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:46 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:46.401549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b281b55f-e4b6-41b8-8dcd-e48e878c7013 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:46.409800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b281b55f-e4b6-41b8-8dcd-e48e878c7013 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.093670 Jul 01 07:08:46.410370 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 30/64] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:46 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:46.551479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:46.552402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:46.559104 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:46.560045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:46.560847 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:46.561377 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:46.635814 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:46.645546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:46.647107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:46.648221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b81ea79c-ca43-4bb7-b830-0b131e0a2210 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.102152 Jul 01 07:08:46.648783 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 35/65] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:46 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:08:47.317199 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-33ba2fe5-7f9c-4db3-acb2-b69d33e712c8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:47.318020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-33ba2fe5-7f9c-4db3-acb2-b69d33e712c8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:47.324759 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-33ba2fe5-7f9c-4db3-acb2-b69d33e712c8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:47.325220 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-33ba2fe5-7f9c-4db3-acb2-b69d33e712c8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:47.331940 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-56bb7304-099a-4c68-b21c-ac184dbd3386 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:47.332952 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-56bb7304-099a-4c68-b21c-ac184dbd3386 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:47.337423 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-33ba2fe5-7f9c-4db3-acb2-b69d33e712c8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:47.337995 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-33ba2fe5-7f9c-4db3-acb2-b69d33e712c8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:47.339846 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-56bb7304-099a-4c68-b21c-ac184dbd3386 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:47.340290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-56bb7304-099a-4c68-b21c-ac184dbd3386 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:47.343184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-56bb7304-099a-4c68-b21c-ac184dbd3386 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:47.344559 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-56bb7304-099a-4c68-b21c-ac184dbd3386 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:47.641460 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-33ba2fe5-7f9c-4db3-acb2-b69d33e712c8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:47.647618 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-56bb7304-099a-4c68-b21c-ac184dbd3386 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:47.650791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-33ba2fe5-7f9c-4db3-acb2-b69d33e712c8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.338545 Jul 01 07:08:47.652003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 31/66] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:47 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:47.658338 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-83979069-9878-4748-9345-9ce3fca3356a tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a828af0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:47.669145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-56bb7304-099a-4c68-b21c-ac184dbd3386 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.341139 Jul 01 07:08:47.680980 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 36/67] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:47 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:47.686546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c4e64d65-2281-4336-a281-3e78f6a2163f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:47.687475 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c4e64d65-2281-4336-a281-3e78f6a2163f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:47.690489 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:47.700959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4e64d65-2281-4336-a281-3e78f6a2163f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:47.701765 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4e64d65-2281-4336-a281-3e78f6a2163f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:47.703878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4e64d65-2281-4336-a281-3e78f6a2163f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:47.705092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4e64d65-2281-4336-a281-3e78f6a2163f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:47.724000 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-83979069-9878-4748-9345-9ce3fca3356a tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] HTTP exception thrown: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-83979069-9878-4748-9345-9ce3fca3356a tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Request method failure captured: Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff HTTP/1.1 Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1eju-sAHUN5eO_qjAuXkLX2Mwk2SK6Yap6wba1WndPBnBN7mpIifzDXkO-lOhkPabz8WrMcF46QZeEAGS9dKR4ShqTt15osNpfTIxLIgPSCIxRG048jqTDsjOxC1O0IHRuWoRZKNZrEDC2_lbIvEQdzPqU_U3iuY9CVNral0EnDoE Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: d1aca28518cc4f5782c74f34479175f1 Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:08:47.728993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d1aca28518cc4f5782c74f34479175f1"}]}] Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: d1aca28518cc4f5782c74f34479175f1 Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-VolumesSnapshotsTestJSON-695101544-project Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: f9c4512401034796abda50f2fda51887 Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-VolumesSnapshotsTestJSON-695101544-project Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': 'f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff'} Jul 01 07:08:47.730152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. (HTTP 404) (Request-ID: req-1d5bec1a-c89f-4197-8b0f-9b8a485f63cc) Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.730865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:08:47.731795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 07:08:47.733728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-83979069-9878-4748-9345-9ce3fca3356a tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Returning 404 to user: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-83979069-9878-4748-9345-9ce3fca3356a tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 404 len: 109 microversion: 2.1 time: 0.076767 Jul 01 07:08:47.735610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 32/68] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:47 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:08:47.737867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:47.738876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:47.746083 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:47.746603 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:47.747467 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:47.747984 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:47.837254 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c4e64d65-2281-4336-a281-3e78f6a2163f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:47.848238 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c4e64d65-2281-4336-a281-3e78f6a2163f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.165919 Jul 01 07:08:47.849552 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 37/69] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:47 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:47.854802 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0dc9c795-69af-406a-8d6e-733fe7959923 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a80f700>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:47.893692 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-0dc9c795-69af-406a-8d6e-733fe7959923 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] HTTP exception thrown: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0dc9c795-69af-406a-8d6e-733fe7959923 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Request method failure captured: Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: DELETE /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff HTTP/1.1 Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1eju-sAHUN5eO_qjAuXkLX2Mwk2SK6Yap6wba1WndPBnBN7mpIifzDXkO-lOhkPabz8WrMcF46QZeEAGS9dKR4ShqTt15osNpfTIxLIgPSCIxRG048jqTDsjOxC1O0IHRuWoRZKNZrEDC2_lbIvEQdzPqU_U3iuY9CVNral0EnDoE Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: d1aca28518cc4f5782c74f34479175f1 Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:08:47.896085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d1aca28518cc4f5782c74f34479175f1"}]}] Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: d1aca28518cc4f5782c74f34479175f1 Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-VolumesSnapshotsTestJSON-695101544-project Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: f9c4512401034796abda50f2fda51887 Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-695101544-project Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': 'f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff'} Jul 01 07:08:47.897417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. (HTTP 404) (Request-ID: req-762b11ac-44a9-40fc-bdf6-eccf42f439cc) Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.898198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 07:08:47.899311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 07:08:47.900710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0dc9c795-69af-406a-8d6e-733fe7959923 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Returning 404 to user: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0dc9c795-69af-406a-8d6e-733fe7959923 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 404 len: 109 microversion: 2.1 time: 0.046537 Jul 01 07:08:47.901833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 38/70] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:08:47 2022] DELETE /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:08:47.908984 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ea489680-302b-4c77-9a60-e9a1e7813829 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Calling method '.version_select at 0x7f2c4a77d550>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:47.919490 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:47.930969 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:47.949149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:47.954164 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-524ece7c-b045-4b93-9273-7e0ce5bd32c8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.221458 Jul 01 07:08:47.956639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 33/71] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:47 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:47.971714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-ea489680-302b-4c77-9a60-e9a1e7813829 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] HTTP exception thrown: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ea489680-302b-4c77-9a60-e9a1e7813829 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Request method failure captured: Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff HTTP/1.1 Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1eju-sAHUN5eO_qjAuXkLX2Mwk2SK6Yap6wba1WndPBnBN7mpIifzDXkO-lOhkPabz8WrMcF46QZeEAGS9dKR4ShqTt15osNpfTIxLIgPSCIxRG048jqTDsjOxC1O0IHRuWoRZKNZrEDC2_lbIvEQdzPqU_U3iuY9CVNral0EnDoE Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: d1aca28518cc4f5782c74f34479175f1 Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:08:47.976130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d1aca28518cc4f5782c74f34479175f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d1aca28518cc4f5782c74f34479175f1"}]}] Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: d1aca28518cc4f5782c74f34479175f1 Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-695101544 Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-VolumesSnapshotsTestJSON-695101544-project Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: f9c4512401034796abda50f2fda51887 Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-695101544-project Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': 'f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff'} Jul 01 07:08:47.977572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. (HTTP 404) (Request-ID: req-2bdb6293-5c6e-4d12-a92e-48dda55862cb) Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.978353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:08:47.979513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 07:08:47.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ea489680-302b-4c77-9a60-e9a1e7813829 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] Returning 404 to user: Volume f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:08:47.982253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ea489680-302b-4c77-9a60-e9a1e7813829 tempest-VolumesSnapshotsTestJSON-695101544 tempest-VolumesSnapshotsTestJSON-695101544-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff" status: 404 len: 109 microversion: 2.1 time: 0.072857 Jul 01 07:08:47.990331 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 39/72] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:08:47 2022] GET /compute/v2.1/os-volumes/f6e261ae-a50d-4b15-9cb4-ff9e4cb00aff => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:08:48.669312 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ffd5f519-3a60-403f-bdde-6efb62e2cf62 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:48.669924 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ffd5f519-3a60-403f-bdde-6efb62e2cf62 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:48.680686 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffd5f519-3a60-403f-bdde-6efb62e2cf62 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:48.683781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffd5f519-3a60-403f-bdde-6efb62e2cf62 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:48.688211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffd5f519-3a60-403f-bdde-6efb62e2cf62 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:48.689327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aa519acb-0f3b-4ede-8441-a657a066d78a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:48.689832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffd5f519-3a60-403f-bdde-6efb62e2cf62 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:48.690649 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-aa519acb-0f3b-4ede-8441-a657a066d78a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:48.709961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa519acb-0f3b-4ede-8441-a657a066d78a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:48.710919 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa519acb-0f3b-4ede-8441-a657a066d78a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:48.711940 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa519acb-0f3b-4ede-8441-a657a066d78a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:48.712588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa519acb-0f3b-4ede-8441-a657a066d78a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:49.024145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=26 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:49.152348 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aa519acb-0f3b-4ede-8441-a657a066d78a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:49.155702 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:49.161379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-aa519acb-0f3b-4ede-8441-a657a066d78a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.477145 Jul 01 07:08:49.170455 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 40/73] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:48 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:49.175968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-106d25eb-083c-427e-b97d-d4d315aeb9a7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:49.182016 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-106d25eb-083c-427e-b97d-d4d315aeb9a7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:49.201288 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-106d25eb-083c-427e-b97d-d4d315aeb9a7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:49.202452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-106d25eb-083c-427e-b97d-d4d315aeb9a7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:49.203673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-106d25eb-083c-427e-b97d-d4d315aeb9a7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:49.203974 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-106d25eb-083c-427e-b97d-d4d315aeb9a7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:49.252343 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ffd5f519-3a60-403f-bdde-6efb62e2cf62 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:49.261047 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ffd5f519-3a60-403f-bdde-6efb62e2cf62 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.596123 Jul 01 07:08:49.268754 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 34/74] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:48 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:49.276722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:49.277426 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:49.300825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:49.301270 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:49.304187 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:49.306125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:49.344766 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-106d25eb-083c-427e-b97d-d4d315aeb9a7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:49.363778 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-106d25eb-083c-427e-b97d-d4d315aeb9a7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.191321 Jul 01 07:08:49.364393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 41/75] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:49 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:49.465933 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:49.494789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:49.499490 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:49.503814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-261bfd9b-b50d-4f44-aab7-c193a6e6c851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.233798 Jul 01 07:08:49.504799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 35/76] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:49 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:50.188180 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-739681b5-b2c0-41c9-8607-f29743b96ced tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:50.188937 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-739681b5-b2c0-41c9-8607-f29743b96ced tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:50.201095 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-739681b5-b2c0-41c9-8607-f29743b96ced tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:50.201657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-739681b5-b2c0-41c9-8607-f29743b96ced tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:50.203233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-739681b5-b2c0-41c9-8607-f29743b96ced tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:50.203876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-739681b5-b2c0-41c9-8607-f29743b96ced tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:50.284906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ee170f45-aa5f-4c61-b190-be263382fedd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:50.286939 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ee170f45-aa5f-4c61-b190-be263382fedd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:50.297511 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee170f45-aa5f-4c61-b190-be263382fedd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:50.298326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee170f45-aa5f-4c61-b190-be263382fedd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:50.299405 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee170f45-aa5f-4c61-b190-be263382fedd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:50.299946 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee170f45-aa5f-4c61-b190-be263382fedd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:50.458925 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-739681b5-b2c0-41c9-8607-f29743b96ced tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:50.469836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-739681b5-b2c0-41c9-8607-f29743b96ced tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.285700 Jul 01 07:08:50.471310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 42/77] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:50 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:50.477911 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7abe772e-7f94-439b-8361-3b40f01aa424 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:50.479465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7abe772e-7f94-439b-8361-3b40f01aa424 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:50.504694 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7abe772e-7f94-439b-8361-3b40f01aa424 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:50.505161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7abe772e-7f94-439b-8361-3b40f01aa424 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:50.506685 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7abe772e-7f94-439b-8361-3b40f01aa424 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:50.507239 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7abe772e-7f94-439b-8361-3b40f01aa424 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:50.533144 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ee170f45-aa5f-4c61-b190-be263382fedd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:50.541831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ee170f45-aa5f-4c61-b190-be263382fedd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.261645 Jul 01 07:08:50.554048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 36/78] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:50 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:50.561710 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:50.562744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:50.571669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:50.572276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:50.573675 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:50.574402 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:50.601097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7abe772e-7f94-439b-8361-3b40f01aa424 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:50.625004 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7abe772e-7f94-439b-8361-3b40f01aa424 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.152103 Jul 01 07:08:50.625583 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 43/79] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:50 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:50.673942 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:50.679533 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:50.686569 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:50.688240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:50.689759 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5e9eca2c-c576-43fb-a6c3-3c4fb4f932c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.134034 Jul 01 07:08:50.690475 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 37/80] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:50 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:51.488656 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-814626d2-3e19-4238-bdd9-1e97c8335015 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:51.489474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-814626d2-3e19-4238-bdd9-1e97c8335015 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:51.498971 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-814626d2-3e19-4238-bdd9-1e97c8335015 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:51.502343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-814626d2-3e19-4238-bdd9-1e97c8335015 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:51.503971 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-814626d2-3e19-4238-bdd9-1e97c8335015 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:51.505339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-814626d2-3e19-4238-bdd9-1e97c8335015 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:51.559793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9a5d2533-ad79-4e94-9444-ee8a9ffb8335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:51.560460 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9a5d2533-ad79-4e94-9444-ee8a9ffb8335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:51.568452 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=4 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:51.572815 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9a5d2533-ad79-4e94-9444-ee8a9ffb8335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:51.574505 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9a5d2533-ad79-4e94-9444-ee8a9ffb8335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:51.576098 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9a5d2533-ad79-4e94-9444-ee8a9ffb8335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:51.576688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9a5d2533-ad79-4e94-9444-ee8a9ffb8335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:51.875634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-814626d2-3e19-4238-bdd9-1e97c8335015 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:51.878979 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-814626d2-3e19-4238-bdd9-1e97c8335015 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.396322 Jul 01 07:08:51.882223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 44/81] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:51 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:51.899832 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1709b92a-d726-4147-ac6a-5f7460b502e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:51.902545 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1709b92a-d726-4147-ac6a-5f7460b502e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:51.915045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1709b92a-d726-4147-ac6a-5f7460b502e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:51.915820 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1709b92a-d726-4147-ac6a-5f7460b502e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:51.917141 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1709b92a-d726-4147-ac6a-5f7460b502e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:51.918025 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9a5d2533-ad79-4e94-9444-ee8a9ffb8335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:51.929674 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9a5d2533-ad79-4e94-9444-ee8a9ffb8335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.372582 Jul 01 07:08:51.931762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1709b92a-d726-4147-ac6a-5f7460b502e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:51.947749 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 38/82] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:51 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:51.953615 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:51.955205 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:51.961708 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:51.962164 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:51.963018 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:51.963458 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:52.111774 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=24 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:52.125523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1709b92a-d726-4147-ac6a-5f7460b502e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:52.138981 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1709b92a-d726-4147-ac6a-5f7460b502e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.254516 Jul 01 07:08:52.140099 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 45/83] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:51 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:52.165642 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:52.179333 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:52.188214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:52.189988 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2af28e95-9b05-46af-9a7a-bbdc0b972f65 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.240967 Jul 01 07:08:52.195067 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 39/84] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:51 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:52.898100 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fb5cf356-171a-4e90-843a-798028d6d23b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:52.898883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fb5cf356-171a-4e90-843a-798028d6d23b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:52.912868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=8 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:52.918318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fb5cf356-171a-4e90-843a-798028d6d23b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:52.919550 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fb5cf356-171a-4e90-843a-798028d6d23b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:52.920878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fb5cf356-171a-4e90-843a-798028d6d23b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:52.921419 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fb5cf356-171a-4e90-843a-798028d6d23b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:52.945997 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bc72ce62-f2c4-4049-bfa1-ff663153aba8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:52.947218 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bc72ce62-f2c4-4049-bfa1-ff663153aba8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:52.950874 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:08:52.962419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc72ce62-f2c4-4049-bfa1-ff663153aba8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:52.967045 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc72ce62-f2c4-4049-bfa1-ff663153aba8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:52.967882 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc72ce62-f2c4-4049-bfa1-ff663153aba8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:52.985615 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc72ce62-f2c4-4049-bfa1-ff663153aba8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:53.359234 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bc72ce62-f2c4-4049-bfa1-ff663153aba8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:53.379121 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bc72ce62-f2c4-4049-bfa1-ff663153aba8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.436539 Jul 01 07:08:53.393316 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 40/85] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:52 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:53.409412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b244fbf3-d4be-4408-9c82-5aa8dae5e901 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:53.410162 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b244fbf3-d4be-4408-9c82-5aa8dae5e901 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:53.437890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fb5cf356-171a-4e90-843a-798028d6d23b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:53.453899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fb5cf356-171a-4e90-843a-798028d6d23b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.553696 Jul 01 07:08:53.453899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 46/86] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:52 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:53.456062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b244fbf3-d4be-4408-9c82-5aa8dae5e901 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:53.456616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b244fbf3-d4be-4408-9c82-5aa8dae5e901 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:53.457443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b244fbf3-d4be-4408-9c82-5aa8dae5e901 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:53.457883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b244fbf3-d4be-4408-9c82-5aa8dae5e901 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:53.461266 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:53.462811 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:53.478371 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:53.478850 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:53.479791 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:53.480411 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:53.627925 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b244fbf3-d4be-4408-9c82-5aa8dae5e901 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:53.628426 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:53.638081 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b244fbf3-d4be-4408-9c82-5aa8dae5e901 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.243399 Jul 01 07:08:53.639992 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 41/87] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:53 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:53.655139 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:53.655139 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:53.655139 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ebf8060f-f06c-468e-9b75-ba3ea2d2e25e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.200723 Jul 01 07:08:53.656816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 47/88] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:53 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:54.399170 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-550e516e-7c54-4557-85d2-d1716fa14a96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:54.400583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-550e516e-7c54-4557-85d2-d1716fa14a96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:54.408577 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-550e516e-7c54-4557-85d2-d1716fa14a96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:54.409028 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-550e516e-7c54-4557-85d2-d1716fa14a96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:54.409807 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-550e516e-7c54-4557-85d2-d1716fa14a96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:54.410217 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-550e516e-7c54-4557-85d2-d1716fa14a96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:54.470138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bc493f59-d789-403d-b9e9-7510f0e80a4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:54.471377 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bc493f59-d789-403d-b9e9-7510f0e80a4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:54.481370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bc493f59-d789-403d-b9e9-7510f0e80a4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:54.481824 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bc493f59-d789-403d-b9e9-7510f0e80a4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:54.483425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bc493f59-d789-403d-b9e9-7510f0e80a4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:54.483878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bc493f59-d789-403d-b9e9-7510f0e80a4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:54.649286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-550e516e-7c54-4557-85d2-d1716fa14a96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:54.658212 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-550e516e-7c54-4557-85d2-d1716fa14a96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.263310 Jul 01 07:08:54.661725 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 42/89] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:54 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:54.666649 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cc801e84-6980-41c2-ad28-8f441168a464 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:54.667408 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cc801e84-6980-41c2-ad28-8f441168a464 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:54.674839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc801e84-6980-41c2-ad28-8f441168a464 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:54.675563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc801e84-6980-41c2-ad28-8f441168a464 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:54.676519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc801e84-6980-41c2-ad28-8f441168a464 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:54.677096 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc801e84-6980-41c2-ad28-8f441168a464 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:54.744640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-bc493f59-d789-403d-b9e9-7510f0e80a4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:54.754889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bc493f59-d789-403d-b9e9-7510f0e80a4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.291416 Jul 01 07:08:54.756056 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 48/90] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:54 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:08:54.760891 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cc801e84-6980-41c2-ad28-8f441168a464 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:54.761657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:54.762501 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:54.771218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:54.771928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:54.772109 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cc801e84-6980-41c2-ad28-8f441168a464 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.109071 Jul 01 07:08:54.772862 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 43/91] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:54 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:54.773502 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:54.774346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:54.867818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:54.876824 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:54.878723 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:54.880382 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2d2456f2-ca42-4563-8f45-1e5d58a32203 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.122853 Jul 01 07:08:54.880953 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 49/92] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:54 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:55.677836 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5463ca55-b5e0-4fbf-b70d-3c392ff2f7c1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:55.678440 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5463ca55-b5e0-4fbf-b70d-3c392ff2f7c1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:55.685015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5463ca55-b5e0-4fbf-b70d-3c392ff2f7c1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:55.685480 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5463ca55-b5e0-4fbf-b70d-3c392ff2f7c1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:55.686222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5463ca55-b5e0-4fbf-b70d-3c392ff2f7c1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:55.686647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5463ca55-b5e0-4fbf-b70d-3c392ff2f7c1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:55.773097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-495c9378-12ae-4b0d-bdb6-4cff22e0618f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:55.774416 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-495c9378-12ae-4b0d-bdb6-4cff22e0618f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:55.780843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-495c9378-12ae-4b0d-bdb6-4cff22e0618f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:55.782186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-495c9378-12ae-4b0d-bdb6-4cff22e0618f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:55.783204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-495c9378-12ae-4b0d-bdb6-4cff22e0618f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:55.784018 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-495c9378-12ae-4b0d-bdb6-4cff22e0618f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:55.820437 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5463ca55-b5e0-4fbf-b70d-3c392ff2f7c1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:55.827976 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5463ca55-b5e0-4fbf-b70d-3c392ff2f7c1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.153780 Jul 01 07:08:55.828860 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 44/93] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:55 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:55.833235 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-49e6ad70-3228-44af-8e6a-e797148dd0a9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:55.833831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-49e6ad70-3228-44af-8e6a-e797148dd0a9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:55.839692 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-49e6ad70-3228-44af-8e6a-e797148dd0a9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:55.840140 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-49e6ad70-3228-44af-8e6a-e797148dd0a9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:55.841249 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-49e6ad70-3228-44af-8e6a-e797148dd0a9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:55.841838 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-49e6ad70-3228-44af-8e6a-e797148dd0a9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:56.068328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-49e6ad70-3228-44af-8e6a-e797148dd0a9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:56.077319 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-49e6ad70-3228-44af-8e6a-e797148dd0a9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1293 microversion: 2.1 time: 0.247447 Jul 01 07:08:56.077981 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 45/94] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:55 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1293 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:56.086396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:56.087071 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:56.093758 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:56.094746 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:56.095563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:56.096385 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:56.103525 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-495c9378-12ae-4b0d-bdb6-4cff22e0618f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:56.112214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-495c9378-12ae-4b0d-bdb6-4cff22e0618f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.342803 Jul 01 07:08:56.112799 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 50/95] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:55 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:08:56.159488 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:56.171173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:56.173631 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:56.174838 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-32dc34fd-72cc-45ac-96bf-41825d073da4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1286 microversion: 2.20 time: 0.095743 Jul 01 07:08:56.175388 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 46/96] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:56 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:56.844122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b25058e9-24b1-4fff-af74-f7e7a8eda716 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:56.845504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b25058e9-24b1-4fff-af74-f7e7a8eda716 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:56.855136 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b25058e9-24b1-4fff-af74-f7e7a8eda716 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:56.855751 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b25058e9-24b1-4fff-af74-f7e7a8eda716 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:56.860721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b25058e9-24b1-4fff-af74-f7e7a8eda716 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:56.861329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b25058e9-24b1-4fff-af74-f7e7a8eda716 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:57.094007 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2bd17507-e331-4588-a41a-0343f7a25fbf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:57.095868 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2bd17507-e331-4588-a41a-0343f7a25fbf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:57.108014 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2bd17507-e331-4588-a41a-0343f7a25fbf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:57.108637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2bd17507-e331-4588-a41a-0343f7a25fbf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:57.111100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2bd17507-e331-4588-a41a-0343f7a25fbf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:57.111911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2bd17507-e331-4588-a41a-0343f7a25fbf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:57.147976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b25058e9-24b1-4fff-af74-f7e7a8eda716 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:57.161849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b25058e9-24b1-4fff-af74-f7e7a8eda716 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.321799 Jul 01 07:08:57.172441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 51/97] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:56 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:57.177808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4c2d6265-ff52-4c76-97e0-a7a8091c6619 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:57.178542 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4c2d6265-ff52-4c76-97e0-a7a8091c6619 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:57.187567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4c2d6265-ff52-4c76-97e0-a7a8091c6619 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:57.187567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4c2d6265-ff52-4c76-97e0-a7a8091c6619 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:57.198201 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4c2d6265-ff52-4c76-97e0-a7a8091c6619 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:57.198878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4c2d6265-ff52-4c76-97e0-a7a8091c6619 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:57.368987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2bd17507-e331-4588-a41a-0343f7a25fbf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:57.381459 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2bd17507-e331-4588-a41a-0343f7a25fbf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1311 microversion: 2.1 time: 0.291821 Jul 01 07:08:57.382300 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 47/98] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:57 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1311 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:57.387652 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:57.388256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:57.395484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:57.396118 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:57.397222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:57.398058 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:57.613281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:57.626807 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:57.631818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:57.635770 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a50238d0-e93c-4a0a-8af6-a2314d5da241 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1334 microversion: 2.20 time: 0.249643 Jul 01 07:08:57.642366 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 48/99] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:57 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1334 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:57.715595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4c2d6265-ff52-4c76-97e0-a7a8091c6619 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:57.736714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4c2d6265-ff52-4c76-97e0-a7a8091c6619 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.561081 Jul 01 07:08:57.738335 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 52/100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:57 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:58.179179 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ca759792-534e-492f-91ae-70cff516994c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:58.179838 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ca759792-534e-492f-91ae-70cff516994c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:58.190642 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ca759792-534e-492f-91ae-70cff516994c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:58.191325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ca759792-534e-492f-91ae-70cff516994c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:58.192269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ca759792-534e-492f-91ae-70cff516994c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:58.202876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ca759792-534e-492f-91ae-70cff516994c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:58.398024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-eca3f227-69bd-4a42-a51a-370790eb8aa6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:58.399211 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-eca3f227-69bd-4a42-a51a-370790eb8aa6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:58.417352 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eca3f227-69bd-4a42-a51a-370790eb8aa6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:58.417788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eca3f227-69bd-4a42-a51a-370790eb8aa6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:58.418591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eca3f227-69bd-4a42-a51a-370790eb8aa6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:58.419097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eca3f227-69bd-4a42-a51a-370790eb8aa6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:58.586822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-eca3f227-69bd-4a42-a51a-370790eb8aa6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:58.598205 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-eca3f227-69bd-4a42-a51a-370790eb8aa6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1299 microversion: 2.1 time: 0.203462 Jul 01 07:08:58.599228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 53/101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:58 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:58.653614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:58.654197 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:58.661371 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:58.661823 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:58.662604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:58.663074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:59.058574 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ca759792-534e-492f-91ae-70cff516994c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:59.076201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ca759792-534e-492f-91ae-70cff516994c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.900943 Jul 01 07:08:59.078686 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 49/102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:58 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:08:59.152538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-74c89e57-eb16-4222-8c5d-45e99d2b2eca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:59.160250 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-74c89e57-eb16-4222-8c5d-45e99d2b2eca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:59.175519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-74c89e57-eb16-4222-8c5d-45e99d2b2eca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:59.177161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-74c89e57-eb16-4222-8c5d-45e99d2b2eca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:59.179492 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-74c89e57-eb16-4222-8c5d-45e99d2b2eca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:59.182669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-74c89e57-eb16-4222-8c5d-45e99d2b2eca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:59.308482 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:59.325026 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:59.329148 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:59.332114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-398e72fe-9a9b-4f1f-823f-f40b9017bb4f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1340 microversion: 2.20 time: 0.682412 Jul 01 07:08:59.335528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 54/103] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:08:58 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1340 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:08:59.503409 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-55b70667-5a6e-4de3-b39b-0d18760e23ed req-5faaf807-7bbd-4c60-8742-9921266a3295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3445a4a9-908c-4f8d-a9f0-192f84c2158a", "tag": "4376d892-b82b-4683-8603-3bf6bc709973"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:08:59.518723 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-55b70667-5a6e-4de3-b39b-0d18760e23ed req-5faaf807-7bbd-4c60-8742-9921266a3295 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:59.519427 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-55b70667-5a6e-4de3-b39b-0d18760e23ed req-5faaf807-7bbd-4c60-8742-9921266a3295 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:59.541671 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-55b70667-5a6e-4de3-b39b-0d18760e23ed req-5faaf807-7bbd-4c60-8742-9921266a3295 service nova] Creating event network-changed:4376d892-b82b-4683-8603-3bf6bc709973 for instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a on hv-cinder-80721 Jul 01 07:08:59.552153 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-55b70667-5a6e-4de3-b39b-0d18760e23ed req-5faaf807-7bbd-4c60-8742-9921266a3295 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165699 Jul 01 07:08:59.553684 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 55/104] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:08:59.618600 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6d7593da-01f6-48fc-b9c3-822eaef1d44c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:08:59.620467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6d7593da-01f6-48fc-b9c3-822eaef1d44c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:08:59.634533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6d7593da-01f6-48fc-b9c3-822eaef1d44c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:59.635452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6d7593da-01f6-48fc-b9c3-822eaef1d44c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:59.636572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6d7593da-01f6-48fc-b9c3-822eaef1d44c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:08:59.637324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6d7593da-01f6-48fc-b9c3-822eaef1d44c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:08:59.660555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-74c89e57-eb16-4222-8c5d-45e99d2b2eca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:59.668352 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-74c89e57-eb16-4222-8c5d-45e99d2b2eca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.576638 Jul 01 07:08:59.670905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 50/105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:59 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:08:59.943252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6d7593da-01f6-48fc-b9c3-822eaef1d44c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:08:59.950910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6d7593da-01f6-48fc-b9c3-822eaef1d44c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.337768 Jul 01 07:08:59.951688 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 56/106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:08:59 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:00.098428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-037331f4-6dae-4d34-854f-c7eab3dd8a78 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:00.099183 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-037331f4-6dae-4d34-854f-c7eab3dd8a78 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:00.105429 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-037331f4-6dae-4d34-854f-c7eab3dd8a78 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:00.105906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-037331f4-6dae-4d34-854f-c7eab3dd8a78 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:00.106734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-037331f4-6dae-4d34-854f-c7eab3dd8a78 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:00.107214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-037331f4-6dae-4d34-854f-c7eab3dd8a78 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:00.294658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-037331f4-6dae-4d34-854f-c7eab3dd8a78 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:00.302920 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-037331f4-6dae-4d34-854f-c7eab3dd8a78 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.209631 Jul 01 07:09:00.303501 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 51/107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:00 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:00.353445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:00.354058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:00.360754 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:00.361203 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:00.362061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:00.362499 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:00.491003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:00.506293 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:00.507821 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:00.508927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-661ebbbd-ca93-43cd-b1df-9dea586cccbb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.159349 Jul 01 07:09:00.509477 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 57/108] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:00 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:00.688375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-962b826c-c502-487d-8e71-29c84448a5c1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:00.688984 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-962b826c-c502-487d-8e71-29c84448a5c1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:00.694954 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-962b826c-c502-487d-8e71-29c84448a5c1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:00.695400 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-962b826c-c502-487d-8e71-29c84448a5c1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:00.696159 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-962b826c-c502-487d-8e71-29c84448a5c1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:00.696590 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-962b826c-c502-487d-8e71-29c84448a5c1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:00.831263 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-962b826c-c502-487d-8e71-29c84448a5c1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:00.838579 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-962b826c-c502-487d-8e71-29c84448a5c1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.154318 Jul 01 07:09:00.839168 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 52/109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:00 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:00.967112 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f271e8cf-29b4-4ccc-b826-b090fb8c5f0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:00.967720 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f271e8cf-29b4-4ccc-b826-b090fb8c5f0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:00.973662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f271e8cf-29b4-4ccc-b826-b090fb8c5f0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:00.974107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f271e8cf-29b4-4ccc-b826-b090fb8c5f0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:00.974889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f271e8cf-29b4-4ccc-b826-b090fb8c5f0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:00.975318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f271e8cf-29b4-4ccc-b826-b090fb8c5f0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:00.979327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:01.099105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f271e8cf-29b4-4ccc-b826-b090fb8c5f0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:01.106493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f271e8cf-29b4-4ccc-b826-b090fb8c5f0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.143292 Jul 01 07:09:01.107096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 58/110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:00 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:01.320173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e5161097-815f-4991-9d03-1a79f695a46a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:01.320853 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e5161097-815f-4991-9d03-1a79f695a46a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:01.326705 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e5161097-815f-4991-9d03-1a79f695a46a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.327170 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e5161097-815f-4991-9d03-1a79f695a46a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.327916 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e5161097-815f-4991-9d03-1a79f695a46a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.328935 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e5161097-815f-4991-9d03-1a79f695a46a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.454962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e5161097-815f-4991-9d03-1a79f695a46a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:01.462255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e5161097-815f-4991-9d03-1a79f695a46a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.145976 Jul 01 07:09:01.462826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 53/111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:01 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:01.526712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:01.527366 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:01.533368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.533845 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.534610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.535071 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.575647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-6e0eb940-c5c5-43df-a641-96305531bb32 req-e8d40175-517a-40a4-91eb-c303e599ac51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15849f34-94b8-4797-b899-2c1e6ea4fb3d", "tag": "8bfa5bd3-77e4-4c39-a2bf-c0c691f11452"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:01.586994 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-6e0eb940-c5c5-43df-a641-96305531bb32 req-e8d40175-517a-40a4-91eb-c303e599ac51 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.587440 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-6e0eb940-c5c5-43df-a641-96305531bb32 req-e8d40175-517a-40a4-91eb-c303e599ac51 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.605941 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-6e0eb940-c5c5-43df-a641-96305531bb32 req-e8d40175-517a-40a4-91eb-c303e599ac51 service nova] Creating event network-changed:8bfa5bd3-77e4-4c39-a2bf-c0c691f11452 for instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d on hv-cinder-80721 Jul 01 07:09:01.606462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-6e0eb940-c5c5-43df-a641-96305531bb32 req-e8d40175-517a-40a4-91eb-c303e599ac51 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117836) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 07:09:01.607588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-388d3712-1533-4b4d-a000-6d8993fff368 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.608024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-388d3712-1533-4b4d-a000-6d8993fff368 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.608826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-388d3712-1533-4b4d-a000-6d8993fff368 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.609257 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-388d3712-1533-4b4d-a000-6d8993fff368 None None] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.615554 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:01.618906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.compute.rpcapi [None req-388d3712-1533-4b4d-a000-6d8993fff368 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 07:09:01.619797 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-388d3712-1533-4b4d-a000-6d8993fff368 None None] Releasing lock "compute-rpcapi-router" {{(pid=117836) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 07:09:01.635141 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-388d3712-1533-4b4d-a000-6d8993fff368 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062966 Jul 01 07:09:01.635735 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 54/112] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:09:01.677043 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:01.685379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:01.686981 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:01.688672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8114a57e-260e-44b0-9f41-6ba9640dfd63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.165887 Jul 01 07:09:01.689226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 59/113] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:01 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:01.855669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-99f017e9-1954-46c8-88b7-eb5e763b6496 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:01.856367 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-99f017e9-1954-46c8-88b7-eb5e763b6496 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:01.863096 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-99f017e9-1954-46c8-88b7-eb5e763b6496 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.863544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-99f017e9-1954-46c8-88b7-eb5e763b6496 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.864300 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-99f017e9-1954-46c8-88b7-eb5e763b6496 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:01.864742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-99f017e9-1954-46c8-88b7-eb5e763b6496 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:01.992869 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-99f017e9-1954-46c8-88b7-eb5e763b6496 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:02.002227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-99f017e9-1954-46c8-88b7-eb5e763b6496 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.150512 Jul 01 07:09:02.002954 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 55/114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:01 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:02.123779 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-823489e4-6fc3-4342-8be1-b19ee79c3875 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:02.124382 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-823489e4-6fc3-4342-8be1-b19ee79c3875 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:02.130661 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-823489e4-6fc3-4342-8be1-b19ee79c3875 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:02.131134 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-823489e4-6fc3-4342-8be1-b19ee79c3875 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:02.131882 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-823489e4-6fc3-4342-8be1-b19ee79c3875 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:02.132309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-823489e4-6fc3-4342-8be1-b19ee79c3875 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:02.259964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-823489e4-6fc3-4342-8be1-b19ee79c3875 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:02.267365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-823489e4-6fc3-4342-8be1-b19ee79c3875 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.147315 Jul 01 07:09:02.267920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 60/115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:02 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:02.478712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ef118473-74c3-4f09-bf7d-0201b0450ec3 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:02.479275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ef118473-74c3-4f09-bf7d-0201b0450ec3 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:02.485313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ef118473-74c3-4f09-bf7d-0201b0450ec3 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:02.485757 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ef118473-74c3-4f09-bf7d-0201b0450ec3 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:02.486511 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ef118473-74c3-4f09-bf7d-0201b0450ec3 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:02.486977 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ef118473-74c3-4f09-bf7d-0201b0450ec3 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:02.610849 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ef118473-74c3-4f09-bf7d-0201b0450ec3 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:02.618094 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ef118473-74c3-4f09-bf7d-0201b0450ec3 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.143361 Jul 01 07:09:02.618649 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 56/116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:02 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:02.706892 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:02.707501 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:02.713499 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:02.713934 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:02.714676 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:02.715169 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:02.841779 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:02.849814 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:02.851357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:02.852464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-25714fc8-5e6d-4aac-b478-343556e76b02 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.149921 Jul 01 07:09:02.853025 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 61/117] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:02 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:03.019838 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5210a409-a62a-4ebc-be05-236069bc11c4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:03.020481 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5210a409-a62a-4ebc-be05-236069bc11c4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:03.026576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5210a409-a62a-4ebc-be05-236069bc11c4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:03.027050 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5210a409-a62a-4ebc-be05-236069bc11c4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:03.027813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5210a409-a62a-4ebc-be05-236069bc11c4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:03.028249 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5210a409-a62a-4ebc-be05-236069bc11c4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:03.154521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5210a409-a62a-4ebc-be05-236069bc11c4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:03.161861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5210a409-a62a-4ebc-be05-236069bc11c4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.146573 Jul 01 07:09:03.162420 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 57/118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:03 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:03.282732 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9d9d67ef-2f99-4b08-bce6-73327de40500 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:03.283308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9d9d67ef-2f99-4b08-bce6-73327de40500 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:03.289285 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9d9d67ef-2f99-4b08-bce6-73327de40500 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:03.289728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9d9d67ef-2f99-4b08-bce6-73327de40500 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:03.290509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9d9d67ef-2f99-4b08-bce6-73327de40500 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:03.290969 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9d9d67ef-2f99-4b08-bce6-73327de40500 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:03.415670 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9d9d67ef-2f99-4b08-bce6-73327de40500 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:03.423413 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9d9d67ef-2f99-4b08-bce6-73327de40500 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.144536 Jul 01 07:09:03.424121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 62/119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:03 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:03.634737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-51e9528f-a73e-4076-9854-210a9011197a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:03.635372 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-51e9528f-a73e-4076-9854-210a9011197a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:03.641353 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-51e9528f-a73e-4076-9854-210a9011197a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:03.641800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-51e9528f-a73e-4076-9854-210a9011197a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:03.642556 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-51e9528f-a73e-4076-9854-210a9011197a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:03.643016 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-51e9528f-a73e-4076-9854-210a9011197a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:03.770750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-51e9528f-a73e-4076-9854-210a9011197a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:03.778094 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-51e9528f-a73e-4076-9854-210a9011197a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.147214 Jul 01 07:09:03.778658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 58/120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:03 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:03.870082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:03.870842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:03.876916 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:03.877356 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:03.878109 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:03.878532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:04.001992 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:04.010657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:04.012242 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:04.013359 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6f483e6a-8255-4587-a0cb-37493809a44f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.147173 Jul 01 07:09:04.013911 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 63/121] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:03 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:04.178967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-896bd3f0-6df4-4ff0-8dad-340410188247 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:04.179494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-896bd3f0-6df4-4ff0-8dad-340410188247 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:04.185621 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-896bd3f0-6df4-4ff0-8dad-340410188247 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:04.186071 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-896bd3f0-6df4-4ff0-8dad-340410188247 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:04.186858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-896bd3f0-6df4-4ff0-8dad-340410188247 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:04.187293 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-896bd3f0-6df4-4ff0-8dad-340410188247 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:04.317042 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-896bd3f0-6df4-4ff0-8dad-340410188247 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:04.324311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-896bd3f0-6df4-4ff0-8dad-340410188247 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.149346 Jul 01 07:09:04.324871 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 59/122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:04 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:04.441085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-202fb0a7-118d-4ab0-b626-38499d1bae6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:04.441608 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-202fb0a7-118d-4ab0-b626-38499d1bae6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:04.447686 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-202fb0a7-118d-4ab0-b626-38499d1bae6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:04.448132 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-202fb0a7-118d-4ab0-b626-38499d1bae6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:04.448885 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-202fb0a7-118d-4ab0-b626-38499d1bae6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:04.449315 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-202fb0a7-118d-4ab0-b626-38499d1bae6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:04.571353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-202fb0a7-118d-4ab0-b626-38499d1bae6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:04.579321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-202fb0a7-118d-4ab0-b626-38499d1bae6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.142669 Jul 01 07:09:04.579886 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 64/123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:04 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:04.795464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-527da938-ff92-4095-a1a4-c112b7962151 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:04.796076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-527da938-ff92-4095-a1a4-c112b7962151 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:04.802574 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-527da938-ff92-4095-a1a4-c112b7962151 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:04.803053 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-527da938-ff92-4095-a1a4-c112b7962151 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:04.803817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-527da938-ff92-4095-a1a4-c112b7962151 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:04.804258 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-527da938-ff92-4095-a1a4-c112b7962151 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:04.931551 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-527da938-ff92-4095-a1a4-c112b7962151 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:04.939820 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-527da938-ff92-4095-a1a4-c112b7962151 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.148147 Jul 01 07:09:04.940383 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 60/124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:04 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:05.031490 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:05.032102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:05.037959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:05.038410 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:05.039195 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:05.039626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:05.169115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:05.177528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:05.179055 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:05.180141 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-21da53c2-94f8-4ecc-b62b-97b781fe8774 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.152479 Jul 01 07:09:05.180690 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 65/125] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:05 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:05.341314 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8e2a7fa8-d8b2-40dd-973d-d0a3855853bd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:05.341851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8e2a7fa8-d8b2-40dd-973d-d0a3855853bd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:05.348299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8e2a7fa8-d8b2-40dd-973d-d0a3855853bd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:05.348742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8e2a7fa8-d8b2-40dd-973d-d0a3855853bd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:05.349493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8e2a7fa8-d8b2-40dd-973d-d0a3855853bd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:05.349924 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8e2a7fa8-d8b2-40dd-973d-d0a3855853bd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:05.473945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8e2a7fa8-d8b2-40dd-973d-d0a3855853bd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:05.481203 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8e2a7fa8-d8b2-40dd-973d-d0a3855853bd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.143790 Jul 01 07:09:05.481753 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 61/126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:05 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:05.596097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aad488b9-4c15-46d9-b613-048c5511b2b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:05.596620 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-aad488b9-4c15-46d9-b613-048c5511b2b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:05.602657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aad488b9-4c15-46d9-b613-048c5511b2b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:05.603138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aad488b9-4c15-46d9-b613-048c5511b2b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:05.603909 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aad488b9-4c15-46d9-b613-048c5511b2b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:05.604339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aad488b9-4c15-46d9-b613-048c5511b2b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:05.732341 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aad488b9-4c15-46d9-b613-048c5511b2b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:05.739703 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-aad488b9-4c15-46d9-b613-048c5511b2b1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.148243 Jul 01 07:09:05.740269 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 66/127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:05 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:05.957436 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b8cd0c4a-ffbf-4bad-8fe0-8bca67bf7190 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:05.958039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b8cd0c4a-ffbf-4bad-8fe0-8bca67bf7190 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:05.963990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8cd0c4a-ffbf-4bad-8fe0-8bca67bf7190 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:05.964429 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8cd0c4a-ffbf-4bad-8fe0-8bca67bf7190 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:05.965175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8cd0c4a-ffbf-4bad-8fe0-8bca67bf7190 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:05.965602 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8cd0c4a-ffbf-4bad-8fe0-8bca67bf7190 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:06.095795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b8cd0c4a-ffbf-4bad-8fe0-8bca67bf7190 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:06.103089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b8cd0c4a-ffbf-4bad-8fe0-8bca67bf7190 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.150477 Jul 01 07:09:06.103637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 62/128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:05 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:06.197295 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:06.197908 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:06.204582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:06.205028 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:06.205792 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:06.206228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:06.337139 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:06.344933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:06.346438 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:06.347565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0d702517-2ee9-4504-aae8-8b636a3703d7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.154188 Jul 01 07:09:06.348118 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 67/129] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:06 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:06.497327 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b60a5c4c-3b99-48b6-9df0-466eca11f679 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:06.497842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b60a5c4c-3b99-48b6-9df0-466eca11f679 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:06.504394 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b60a5c4c-3b99-48b6-9df0-466eca11f679 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:06.504839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b60a5c4c-3b99-48b6-9df0-466eca11f679 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:06.505589 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b60a5c4c-3b99-48b6-9df0-466eca11f679 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:06.506015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b60a5c4c-3b99-48b6-9df0-466eca11f679 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:06.632648 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b60a5c4c-3b99-48b6-9df0-466eca11f679 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:06.639924 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b60a5c4c-3b99-48b6-9df0-466eca11f679 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.146446 Jul 01 07:09:06.640481 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 63/130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:06 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:06.756555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d02e9929-e96e-434e-83d1-54dbd071684f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:06.757076 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d02e9929-e96e-434e-83d1-54dbd071684f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:06.763384 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d02e9929-e96e-434e-83d1-54dbd071684f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:06.763821 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d02e9929-e96e-434e-83d1-54dbd071684f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:06.764566 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d02e9929-e96e-434e-83d1-54dbd071684f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:06.764999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d02e9929-e96e-434e-83d1-54dbd071684f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:06.888973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d02e9929-e96e-434e-83d1-54dbd071684f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:06.896390 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d02e9929-e96e-434e-83d1-54dbd071684f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.143704 Jul 01 07:09:06.897006 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 68/131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:06 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:07.119616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-41517524-728e-4c7b-ba53-44943e807793 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:07.120286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-41517524-728e-4c7b-ba53-44943e807793 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:07.126161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41517524-728e-4c7b-ba53-44943e807793 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:07.126630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41517524-728e-4c7b-ba53-44943e807793 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:07.127497 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41517524-728e-4c7b-ba53-44943e807793 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:07.127931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41517524-728e-4c7b-ba53-44943e807793 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:07.259251 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-41517524-728e-4c7b-ba53-44943e807793 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:07.266503 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-41517524-728e-4c7b-ba53-44943e807793 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.150724 Jul 01 07:09:07.267656 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 64/132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:07 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:07.365073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:07.365613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:07.371845 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:07.372327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:07.373118 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:07.373552 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:07.501131 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:07.509620 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:07.511140 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:07.512234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-323458b0-c9e5-4525-9f45-444281028d15 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.151021 Jul 01 07:09:07.512780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 69/133] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:07 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:07.656236 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-10072817-5f21-4dd6-8117-d1674b66c596 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:07.656776 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-10072817-5f21-4dd6-8117-d1674b66c596 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:07.662716 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-10072817-5f21-4dd6-8117-d1674b66c596 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:07.663198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-10072817-5f21-4dd6-8117-d1674b66c596 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:07.663955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-10072817-5f21-4dd6-8117-d1674b66c596 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:07.664397 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-10072817-5f21-4dd6-8117-d1674b66c596 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:07.790532 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-10072817-5f21-4dd6-8117-d1674b66c596 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:07.798921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-10072817-5f21-4dd6-8117-d1674b66c596 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.145725 Jul 01 07:09:07.799211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 65/134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:07 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:07.912977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f4110137-16d3-49f4-870f-e1143ae84730 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:07.913520 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f4110137-16d3-49f4-870f-e1143ae84730 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:07.919464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f4110137-16d3-49f4-870f-e1143ae84730 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:07.919910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f4110137-16d3-49f4-870f-e1143ae84730 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:07.920659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f4110137-16d3-49f4-870f-e1143ae84730 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:07.921091 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f4110137-16d3-49f4-870f-e1143ae84730 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:08.049672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f4110137-16d3-49f4-870f-e1143ae84730 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:08.056934 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f4110137-16d3-49f4-870f-e1143ae84730 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.147844 Jul 01 07:09:08.057486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 70/135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:07 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:08.283997 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-003981f3-70b2-4bd3-b270-b3fd22863335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:08.284593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-003981f3-70b2-4bd3-b270-b3fd22863335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:08.290468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-003981f3-70b2-4bd3-b270-b3fd22863335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:08.290956 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-003981f3-70b2-4bd3-b270-b3fd22863335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:08.291709 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-003981f3-70b2-4bd3-b270-b3fd22863335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:08.292136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-003981f3-70b2-4bd3-b270-b3fd22863335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:08.414974 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-003981f3-70b2-4bd3-b270-b3fd22863335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:08.422412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-003981f3-70b2-4bd3-b270-b3fd22863335 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.142702 Jul 01 07:09:08.423034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 66/136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:08 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:08.530560 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:08.531124 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:08.537802 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:08.538251 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:08.539068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:08.539976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:08.667055 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:08.676005 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:08.678055 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:08.679290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-71bfe4e2-6a02-4cda-b998-42db3b479a36 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.152540 Jul 01 07:09:08.680155 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 71/137] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:08 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:08.815299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-85a8515e-7235-4bdd-9b44-152f15cb9e76 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:08.815832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-85a8515e-7235-4bdd-9b44-152f15cb9e76 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:08.821713 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-85a8515e-7235-4bdd-9b44-152f15cb9e76 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:08.822151 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-85a8515e-7235-4bdd-9b44-152f15cb9e76 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:08.823007 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-85a8515e-7235-4bdd-9b44-152f15cb9e76 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:08.823434 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-85a8515e-7235-4bdd-9b44-152f15cb9e76 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:08.947130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-85a8515e-7235-4bdd-9b44-152f15cb9e76 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:08.954330 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-85a8515e-7235-4bdd-9b44-152f15cb9e76 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.143533 Jul 01 07:09:08.955515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 67/138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:08 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:09.073433 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e399c558-4a8b-4586-9546-902358906b5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:09.074045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e399c558-4a8b-4586-9546-902358906b5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:09.080813 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e399c558-4a8b-4586-9546-902358906b5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:09.081256 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e399c558-4a8b-4586-9546-902358906b5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:09.082018 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e399c558-4a8b-4586-9546-902358906b5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:09.082449 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e399c558-4a8b-4586-9546-902358906b5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:09.209927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e399c558-4a8b-4586-9546-902358906b5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:09.217325 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e399c558-4a8b-4586-9546-902358906b5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.147667 Jul 01 07:09:09.217881 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 72/139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:09 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:09.440368 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-35e9ee9c-d8f6-4ad4-acde-159998505292 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:09.440966 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-35e9ee9c-d8f6-4ad4-acde-159998505292 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:09.447162 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-35e9ee9c-d8f6-4ad4-acde-159998505292 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:09.447649 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-35e9ee9c-d8f6-4ad4-acde-159998505292 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:09.448434 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-35e9ee9c-d8f6-4ad4-acde-159998505292 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:09.448886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-35e9ee9c-d8f6-4ad4-acde-159998505292 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:09.574400 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-35e9ee9c-d8f6-4ad4-acde-159998505292 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:09.581725 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-35e9ee9c-d8f6-4ad4-acde-159998505292 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.145683 Jul 01 07:09:09.582221 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 68/140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:09 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:09.698014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:09.698614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:09.705235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:09.705728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:09.706560 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:09.707070 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:09.834033 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:09.841700 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:09.843228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:09.844325 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7a8e4c60-b089-4a6b-82ff-adb744b7feea tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.150473 Jul 01 07:09:09.844883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 73/141] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:09 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:09.972877 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6dd24d8e-34c1-4a6f-8ada-3218d0206eec tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:09.973373 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6dd24d8e-34c1-4a6f-8ada-3218d0206eec tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:09.979778 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6dd24d8e-34c1-4a6f-8ada-3218d0206eec tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:09.980290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6dd24d8e-34c1-4a6f-8ada-3218d0206eec tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:09.980952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6dd24d8e-34c1-4a6f-8ada-3218d0206eec tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:09.981380 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6dd24d8e-34c1-4a6f-8ada-3218d0206eec tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:10.116072 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6dd24d8e-34c1-4a6f-8ada-3218d0206eec tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:10.123428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6dd24d8e-34c1-4a6f-8ada-3218d0206eec tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.155504 Jul 01 07:09:10.124006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 69/142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:09 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:10.234712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-dd0b3f3a-ccf5-4950-a62a-1781efe67a01 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:10.235380 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-dd0b3f3a-ccf5-4950-a62a-1781efe67a01 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:10.242145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd0b3f3a-ccf5-4950-a62a-1781efe67a01 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:10.242593 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd0b3f3a-ccf5-4950-a62a-1781efe67a01 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:10.243393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd0b3f3a-ccf5-4950-a62a-1781efe67a01 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:10.243818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd0b3f3a-ccf5-4950-a62a-1781efe67a01 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:10.388067 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dd0b3f3a-ccf5-4950-a62a-1781efe67a01 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:10.392781 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:10.398329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-dd0b3f3a-ccf5-4950-a62a-1781efe67a01 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.168461 Jul 01 07:09:10.399272 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 74/143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:10 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:10.600090 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-55ee0ab1-a389-4593-935b-c24a939ba630 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:10.601746 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-55ee0ab1-a389-4593-935b-c24a939ba630 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:10.611169 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-55ee0ab1-a389-4593-935b-c24a939ba630 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:10.611695 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-55ee0ab1-a389-4593-935b-c24a939ba630 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:10.613417 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-55ee0ab1-a389-4593-935b-c24a939ba630 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:10.614077 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-55ee0ab1-a389-4593-935b-c24a939ba630 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:10.862737 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:10.864253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:10.870690 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:10.871395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:10.872384 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:10.873015 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:11.445591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-55ee0ab1-a389-4593-935b-c24a939ba630 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:11.460536 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-55ee0ab1-a389-4593-935b-c24a939ba630 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.865976 Jul 01 07:09:11.461120 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 70/144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:10 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:11.467502 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4c004138-15eb-497b-8903-0f78fab63354 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:11.468478 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4c004138-15eb-497b-8903-0f78fab63354 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:11.493305 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c004138-15eb-497b-8903-0f78fab63354 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:11.503934 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c004138-15eb-497b-8903-0f78fab63354 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:11.505731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c004138-15eb-497b-8903-0f78fab63354 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:11.508145 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c004138-15eb-497b-8903-0f78fab63354 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:11.561839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:11.579232 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:11.590836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:11.597218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:11.598746 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-459c9f92-b6c0-402d-b022-95d2a1823980 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.740825 Jul 01 07:09:11.601806 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 75/145] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:10 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:09:11.609729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-7e60c3c5-c1e2-4b3b-9020-0cf473a0119c req-44ce03cb-4d9f-4925-a0b8-826a44bd36bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587ab81f-e92f-455f-8cc0-09463978813d", "tag": "078a7f98-f4b7-4477-a055-a3fb79cc3fa2"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:11.616672 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:11.633170 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-7e60c3c5-c1e2-4b3b-9020-0cf473a0119c req-44ce03cb-4d9f-4925-a0b8-826a44bd36bf service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:11.635654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-7e60c3c5-c1e2-4b3b-9020-0cf473a0119c req-44ce03cb-4d9f-4925-a0b8-826a44bd36bf service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:11.672328 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-7e60c3c5-c1e2-4b3b-9020-0cf473a0119c req-44ce03cb-4d9f-4925-a0b8-826a44bd36bf service nova] Creating event network-changed:078a7f98-f4b7-4477-a055-a3fb79cc3fa2 for instance 587ab81f-e92f-455f-8cc0-09463978813d on hv-cinder-80721 Jul 01 07:09:11.690899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-7e60c3c5-c1e2-4b3b-9020-0cf473a0119c req-44ce03cb-4d9f-4925-a0b8-826a44bd36bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082932 Jul 01 07:09:11.694452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 76/146] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:11.701626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c8196122-838a-4c12-af6f-c2416870813d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:11.702301 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c8196122-838a-4c12-af6f-c2416870813d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:11.711181 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c8196122-838a-4c12-af6f-c2416870813d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:11.711627 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c8196122-838a-4c12-af6f-c2416870813d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:11.713172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c8196122-838a-4c12-af6f-c2416870813d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:11.713996 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c8196122-838a-4c12-af6f-c2416870813d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:12.284968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4c004138-15eb-497b-8903-0f78fab63354 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:12.301008 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c8196122-838a-4c12-af6f-c2416870813d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:12.301582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4c004138-15eb-497b-8903-0f78fab63354 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.838448 Jul 01 07:09:12.312149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 71/147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:11 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:12.319683 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c8196122-838a-4c12-af6f-c2416870813d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.623773 Jul 01 07:09:12.320361 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 77/148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:11 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:12.480348 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6fe4abde-2a4e-4baa-b87f-f14992a94175 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:12.481161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6fe4abde-2a4e-4baa-b87f-f14992a94175 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:12.488149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6fe4abde-2a4e-4baa-b87f-f14992a94175 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:12.488683 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6fe4abde-2a4e-4baa-b87f-f14992a94175 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:12.489569 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6fe4abde-2a4e-4baa-b87f-f14992a94175 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:12.490207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6fe4abde-2a4e-4baa-b87f-f14992a94175 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:12.619692 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:12.620332 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:12.626927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:12.627468 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:12.628325 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:12.628823 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:12.974243 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6fe4abde-2a4e-4baa-b87f-f14992a94175 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:12.987682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6fe4abde-2a4e-4baa-b87f-f14992a94175 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.513397 Jul 01 07:09:12.991595 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 72/149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:12 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:13.101729 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-d13fdfb7-bb4e-40ef-9305-f827319967c6 req-03b47ae8-84ad-453a-a09b-0e22c62a7070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e3db32-ed35-4c27-ad2f-30bfbe556c25", "tag": "37b4518e-4b3f-4f6d-9030-a07d10ba59c5"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:13.107616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:13.119664 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:13.126083 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-d13fdfb7-bb4e-40ef-9305-f827319967c6 req-03b47ae8-84ad-453a-a09b-0e22c62a7070 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:13.127263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:13.128438 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-24eb62c3-8ccb-4301-86a9-501bdc31eb2a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.512666 Jul 01 07:09:13.129000 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 78/150] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:12 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:09:13.138985 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-d13fdfb7-bb4e-40ef-9305-f827319967c6 req-03b47ae8-84ad-453a-a09b-0e22c62a7070 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:13.151822 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-d13fdfb7-bb4e-40ef-9305-f827319967c6 req-03b47ae8-84ad-453a-a09b-0e22c62a7070 service nova] Creating event network-changed:37b4518e-4b3f-4f6d-9030-a07d10ba59c5 for instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 on hv-cinder-80721 Jul 01 07:09:13.160495 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-d13fdfb7-bb4e-40ef-9305-f827319967c6 req-03b47ae8-84ad-453a-a09b-0e22c62a7070 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062862 Jul 01 07:09:13.163985 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 73/151] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:13.323197 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-89ad16b4-31a6-470c-bac3-57d97ca4b8d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:13.324986 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-89ad16b4-31a6-470c-bac3-57d97ca4b8d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:13.335678 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-89ad16b4-31a6-470c-bac3-57d97ca4b8d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:13.336512 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-89ad16b4-31a6-470c-bac3-57d97ca4b8d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:13.337618 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-89ad16b4-31a6-470c-bac3-57d97ca4b8d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:13.338223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-89ad16b4-31a6-470c-bac3-57d97ca4b8d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:13.338938 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-963213ab-3530-4ad4-93e0-c5c72f29e6c1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:13.340078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-963213ab-3530-4ad4-93e0-c5c72f29e6c1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:13.356114 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-963213ab-3530-4ad4-93e0-c5c72f29e6c1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:13.356799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-963213ab-3530-4ad4-93e0-c5c72f29e6c1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:13.357747 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-963213ab-3530-4ad4-93e0-c5c72f29e6c1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:13.358330 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-963213ab-3530-4ad4-93e0-c5c72f29e6c1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:13.595669 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-89ad16b4-31a6-470c-bac3-57d97ca4b8d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:13.600388 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-963213ab-3530-4ad4-93e0-c5c72f29e6c1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:13.606328 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-89ad16b4-31a6-470c-bac3-57d97ca4b8d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.290767 Jul 01 07:09:13.609355 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-963213ab-3530-4ad4-93e0-c5c72f29e6c1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.275271 Jul 01 07:09:13.618368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 79/152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:13 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:13.621094 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 74/153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:13 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:14.008306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9dec7a75-40f6-4171-9b1e-c05e770e7600 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:14.008923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9dec7a75-40f6-4171-9b1e-c05e770e7600 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:14.018247 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9dec7a75-40f6-4171-9b1e-c05e770e7600 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:14.019060 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9dec7a75-40f6-4171-9b1e-c05e770e7600 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:14.020396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9dec7a75-40f6-4171-9b1e-c05e770e7600 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:14.021019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9dec7a75-40f6-4171-9b1e-c05e770e7600 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:14.151017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:14.151846 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:14.162659 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:14.163146 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:14.163931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:14.164568 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:14.585307 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9dec7a75-40f6-4171-9b1e-c05e770e7600 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:14.603176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9dec7a75-40f6-4171-9b1e-c05e770e7600 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.599028 Jul 01 07:09:14.603934 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 80/154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:14 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:14.623707 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-19692e56-a013-41c2-8308-204989a1adcf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:14.624529 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-19692e56-a013-41c2-8308-204989a1adcf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:14.635168 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-19692e56-a013-41c2-8308-204989a1adcf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:14.635654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-19692e56-a013-41c2-8308-204989a1adcf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:14.636457 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-19692e56-a013-41c2-8308-204989a1adcf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:14.636897 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-19692e56-a013-41c2-8308-204989a1adcf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:14.836269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:14.846505 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:14.848423 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:14.849764 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cc0481f2-c936-483c-bccc-88d2ac8ab99d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.707677 Jul 01 07:09:14.864299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 75/155] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:14 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:14.871002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e8ec9e23-b034-49f6-8891-4157631f3d5c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:14.871619 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e8ec9e23-b034-49f6-8891-4157631f3d5c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:14.889612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8ec9e23-b034-49f6-8891-4157631f3d5c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:14.890153 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8ec9e23-b034-49f6-8891-4157631f3d5c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:14.890895 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8ec9e23-b034-49f6-8891-4157631f3d5c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:14.891337 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8ec9e23-b034-49f6-8891-4157631f3d5c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:14.964228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-19692e56-a013-41c2-8308-204989a1adcf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:14.980259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-19692e56-a013-41c2-8308-204989a1adcf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.360060 Jul 01 07:09:14.983465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 81/156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:14 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:15.081367 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e8ec9e23-b034-49f6-8891-4157631f3d5c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:15.088811 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e8ec9e23-b034-49f6-8891-4157631f3d5c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.223196 Jul 01 07:09:15.098058 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 76/157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:14 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:15.621486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-af77c59f-4cfe-4aae-8a55-132f8d7d03b5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:15.622200 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-af77c59f-4cfe-4aae-8a55-132f8d7d03b5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:15.628718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af77c59f-4cfe-4aae-8a55-132f8d7d03b5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:15.629515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af77c59f-4cfe-4aae-8a55-132f8d7d03b5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:15.630804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af77c59f-4cfe-4aae-8a55-132f8d7d03b5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:15.631243 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af77c59f-4cfe-4aae-8a55-132f8d7d03b5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:15.791279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-af77c59f-4cfe-4aae-8a55-132f8d7d03b5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:15.799473 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-af77c59f-4cfe-4aae-8a55-132f8d7d03b5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.182761 Jul 01 07:09:15.800373 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 82/158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:15 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:15.874801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:15.875490 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:15.882745 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:15.883318 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:15.884210 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:15.884698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:16.000672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-585c6c3c-e613-4d7b-b442-b5425eec825b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:16.002308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-585c6c3c-e613-4d7b-b442-b5425eec825b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:16.011255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-585c6c3c-e613-4d7b-b442-b5425eec825b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:16.012101 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-585c6c3c-e613-4d7b-b442-b5425eec825b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:16.013083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-585c6c3c-e613-4d7b-b442-b5425eec825b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:16.013890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-585c6c3c-e613-4d7b-b442-b5425eec825b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:16.163333 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:16.173929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:16.175582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:16.176786 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b311527d-64e6-4f72-a326-3521b3398491 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.306888 Jul 01 07:09:16.177554 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 77/159] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:15 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:16.193721 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4795b87e-630b-49d5-8947-9994e1a921ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:16.194410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4795b87e-630b-49d5-8947-9994e1a921ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:16.205422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4795b87e-630b-49d5-8947-9994e1a921ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:16.205849 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4795b87e-630b-49d5-8947-9994e1a921ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:16.206697 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4795b87e-630b-49d5-8947-9994e1a921ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:16.207312 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4795b87e-630b-49d5-8947-9994e1a921ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:16.250153 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-585c6c3c-e613-4d7b-b442-b5425eec825b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:16.257904 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-585c6c3c-e613-4d7b-b442-b5425eec825b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.261994 Jul 01 07:09:16.258497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 83/160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:15 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:16.375309 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4795b87e-630b-49d5-8947-9994e1a921ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:16.385560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4795b87e-630b-49d5-8947-9994e1a921ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.197095 Jul 01 07:09:16.386351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 78/161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:16 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:16.825150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-63c4ad44-f761-4127-b3b3-c37ee3468a5f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:16.825150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-63c4ad44-f761-4127-b3b3-c37ee3468a5f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:16.825893 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-63c4ad44-f761-4127-b3b3-c37ee3468a5f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:16.828555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-63c4ad44-f761-4127-b3b3-c37ee3468a5f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:16.829493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-63c4ad44-f761-4127-b3b3-c37ee3468a5f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:16.829915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-63c4ad44-f761-4127-b3b3-c37ee3468a5f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:17.195518 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:17.196852 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:17.224872 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:17.225561 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:17.226733 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:17.235297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:17.446037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-63c4ad44-f761-4127-b3b3-c37ee3468a5f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:17.465322 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-63c4ad44-f761-4127-b3b3-c37ee3468a5f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.649454 Jul 01 07:09:17.466356 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 84/162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:16 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:17.479590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ab5c036e-fe6b-4a34-a81d-dbe496b1645a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:17.480351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ab5c036e-fe6b-4a34-a81d-dbe496b1645a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:17.487101 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ab5c036e-fe6b-4a34-a81d-dbe496b1645a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:17.488691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ab5c036e-fe6b-4a34-a81d-dbe496b1645a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:17.490272 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ab5c036e-fe6b-4a34-a81d-dbe496b1645a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:17.491063 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ab5c036e-fe6b-4a34-a81d-dbe496b1645a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:17.899554 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:17.909302 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:17.913079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:17.916276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c37b33d3-5aaa-4600-b3dc-75f8b191bf81 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.725121 Jul 01 07:09:17.918404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 79/163] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:17 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:09:17.929996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-57ca80eb-ae64-4f65-8c2b-1f03952148f4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:17.932044 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-57ca80eb-ae64-4f65-8c2b-1f03952148f4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:17.939875 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-57ca80eb-ae64-4f65-8c2b-1f03952148f4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:17.941134 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-57ca80eb-ae64-4f65-8c2b-1f03952148f4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:17.942616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-57ca80eb-ae64-4f65-8c2b-1f03952148f4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:17.945416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-57ca80eb-ae64-4f65-8c2b-1f03952148f4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:17.973321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ab5c036e-fe6b-4a34-a81d-dbe496b1645a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:17.984312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ab5c036e-fe6b-4a34-a81d-dbe496b1645a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.514632 Jul 01 07:09:17.986355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 85/164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:17 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:18.131636 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-57ca80eb-ae64-4f65-8c2b-1f03952148f4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:18.141941 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-57ca80eb-ae64-4f65-8c2b-1f03952148f4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.222435 Jul 01 07:09:18.142753 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 80/165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:17 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:18.269499 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-16459194-026e-4d76-9ab7-cd9e93653982 req-91d4145d-a814-4d5f-b251-2469badc8c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587ab81f-e92f-455f-8cc0-09463978813d", "name": "network-vif-plugged", "status": "completed", "tag": "078a7f98-f4b7-4477-a055-a3fb79cc3fa2"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:18.277425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=93 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:18.279610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-16459194-026e-4d76-9ab7-cd9e93653982 req-91d4145d-a814-4d5f-b251-2469badc8c45 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:18.280578 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-16459194-026e-4d76-9ab7-cd9e93653982 req-91d4145d-a814-4d5f-b251-2469badc8c45 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:18.294573 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-16459194-026e-4d76-9ab7-cd9e93653982 req-91d4145d-a814-4d5f-b251-2469badc8c45 service nova] Creating event network-vif-plugged:078a7f98-f4b7-4477-a055-a3fb79cc3fa2 for instance 587ab81f-e92f-455f-8cc0-09463978813d on hv-cinder-80721 Jul 01 07:09:18.300709 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-16459194-026e-4d76-9ab7-cd9e93653982 req-91d4145d-a814-4d5f-b251-2469badc8c45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312371 Jul 01 07:09:18.301421 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 86/166] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:18.482747 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ee1857b2-b38b-4554-b81d-53eee0a22b50 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:18.483466 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ee1857b2-b38b-4554-b81d-53eee0a22b50 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:18.490264 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee1857b2-b38b-4554-b81d-53eee0a22b50 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:18.490793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee1857b2-b38b-4554-b81d-53eee0a22b50 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:18.491627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee1857b2-b38b-4554-b81d-53eee0a22b50 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:18.492118 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee1857b2-b38b-4554-b81d-53eee0a22b50 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:18.681955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ee1857b2-b38b-4554-b81d-53eee0a22b50 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:18.691287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ee1857b2-b38b-4554-b81d-53eee0a22b50 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.212225 Jul 01 07:09:18.691976 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 81/167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:18 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:18.936476 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:18.937195 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:18.952268 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:18.952709 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:18.953791 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:18.954750 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:19.003004 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d1fb1651-6ba3-4fac-88b0-e4d5b005f0ad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:19.003746 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d1fb1651-6ba3-4fac-88b0-e4d5b005f0ad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:19.010111 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d1fb1651-6ba3-4fac-88b0-e4d5b005f0ad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:19.010558 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d1fb1651-6ba3-4fac-88b0-e4d5b005f0ad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:19.011351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d1fb1651-6ba3-4fac-88b0-e4d5b005f0ad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:19.011789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d1fb1651-6ba3-4fac-88b0-e4d5b005f0ad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:19.130431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:19.138617 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:19.140079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:19.141185 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f9f2da92-9b04-4a56-bf4d-960f19112438 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.209626 Jul 01 07:09:19.141748 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 87/168] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:18 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:19.158910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-002681e7-0756-4d6c-a8e4-018c3ea34811 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:19.159513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-002681e7-0756-4d6c-a8e4-018c3ea34811 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:19.165765 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-002681e7-0756-4d6c-a8e4-018c3ea34811 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:19.166207 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-002681e7-0756-4d6c-a8e4-018c3ea34811 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:19.167011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-002681e7-0756-4d6c-a8e4-018c3ea34811 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:19.167435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-002681e7-0756-4d6c-a8e4-018c3ea34811 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:19.175022 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d1fb1651-6ba3-4fac-88b0-e4d5b005f0ad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:19.182362 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d1fb1651-6ba3-4fac-88b0-e4d5b005f0ad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.183755 Jul 01 07:09:19.182985 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 82/169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:18 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:19.292879 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-002681e7-0756-4d6c-a8e4-018c3ea34811 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:19.300788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-002681e7-0756-4d6c-a8e4-018c3ea34811 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.145476 Jul 01 07:09:19.301349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 88/170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:19 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:19.708004 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-98c40101-3f58-497f-8d13-55e783a62896 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:19.708725 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-98c40101-3f58-497f-8d13-55e783a62896 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:19.714673 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-98c40101-3f58-497f-8d13-55e783a62896 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:19.715087 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-98c40101-3f58-497f-8d13-55e783a62896 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:19.715842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-98c40101-3f58-497f-8d13-55e783a62896 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:19.716273 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-98c40101-3f58-497f-8d13-55e783a62896 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:19.853993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-98c40101-3f58-497f-8d13-55e783a62896 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:19.862219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-98c40101-3f58-497f-8d13-55e783a62896 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.158532 Jul 01 07:09:19.862945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 83/171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:19 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:20.160387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:20.161008 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:20.167062 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.167566 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:20.168318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.168743 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:20.200159 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8d642e4b-3927-4856-a0f0-a033f3e5925b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:20.200873 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8d642e4b-3927-4856-a0f0-a033f3e5925b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:20.207139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8d642e4b-3927-4856-a0f0-a033f3e5925b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.207661 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8d642e4b-3927-4856-a0f0-a033f3e5925b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:20.208588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8d642e4b-3927-4856-a0f0-a033f3e5925b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.209185 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8d642e4b-3927-4856-a0f0-a033f3e5925b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:20.339988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:20.348677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:20.350167 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:20.351604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a601039d-5152-49ca-b38a-2b70597fb872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.196452 Jul 01 07:09:20.352209 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 89/172] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:20 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:09:20.356491 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-a9c79c34-c7f7-4ea0-9feb-12e69cbec720 req-98d7b87d-4db1-4a68-8924-db6b9c96b4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc68164-9c81-4c8c-92a9-7845381bbff8", "name": "network-vif-plugged", "status": "completed", "tag": "8e8b676a-7f20-4a8f-bf53-71349dc3312b"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:20.364868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-a9c79c34-c7f7-4ea0-9feb-12e69cbec720 req-98d7b87d-4db1-4a68-8924-db6b9c96b4af service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.365302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-a9c79c34-c7f7-4ea0-9feb-12e69cbec720 req-98d7b87d-4db1-4a68-8924-db6b9c96b4af service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:20.374793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8d642e4b-3927-4856-a0f0-a033f3e5925b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:20.377454 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-a9c79c34-c7f7-4ea0-9feb-12e69cbec720 req-98d7b87d-4db1-4a68-8924-db6b9c96b4af service nova] Creating event network-vif-plugged:8e8b676a-7f20-4a8f-bf53-71349dc3312b for instance afc68164-9c81-4c8c-92a9-7845381bbff8 on hv-cinder-80721 Jul 01 07:09:20.382247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8d642e4b-3927-4856-a0f0-a033f3e5925b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.185838 Jul 01 07:09:20.382592 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-a9c79c34-c7f7-4ea0-9feb-12e69cbec720 req-98d7b87d-4db1-4a68-8924-db6b9c96b4af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029288 Jul 01 07:09:20.383201 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 90/173] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:20.388298 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 84/174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:20 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:20.388508 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9674a546-bf2d-492c-847a-28d32179b984 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:20.388983 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9674a546-bf2d-492c-847a-28d32179b984 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:20.395262 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9674a546-bf2d-492c-847a-28d32179b984 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.395697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9674a546-bf2d-492c-847a-28d32179b984 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:20.396439 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9674a546-bf2d-492c-847a-28d32179b984 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.396861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9674a546-bf2d-492c-847a-28d32179b984 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:20.529701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9674a546-bf2d-492c-847a-28d32179b984 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:20.537703 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9674a546-bf2d-492c-847a-28d32179b984 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.153366 Jul 01 07:09:20.538257 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 91/175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:20 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:20.879452 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ae880a9f-1755-42c5-bc1e-821686a7f6ca tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:20.880065 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ae880a9f-1755-42c5-bc1e-821686a7f6ca tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:20.885946 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ae880a9f-1755-42c5-bc1e-821686a7f6ca tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.886394 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ae880a9f-1755-42c5-bc1e-821686a7f6ca tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:20.887176 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ae880a9f-1755-42c5-bc1e-821686a7f6ca tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:20.887608 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ae880a9f-1755-42c5-bc1e-821686a7f6ca tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:21.019799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ae880a9f-1755-42c5-bc1e-821686a7f6ca tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:21.027088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ae880a9f-1755-42c5-bc1e-821686a7f6ca tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.152062 Jul 01 07:09:21.027651 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 85/176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:20 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:21.370057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:21.370664 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:21.377436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:21.377882 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:21.378651 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:21.379090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:21.399375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1fe97a48-c6f2-464c-9832-7b1a2b8682dc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:21.399984 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1fe97a48-c6f2-464c-9832-7b1a2b8682dc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:21.406632 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1fe97a48-c6f2-464c-9832-7b1a2b8682dc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:21.407432 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1fe97a48-c6f2-464c-9832-7b1a2b8682dc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:21.409081 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1fe97a48-c6f2-464c-9832-7b1a2b8682dc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:21.409525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1fe97a48-c6f2-464c-9832-7b1a2b8682dc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:21.572279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:21.585759 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:21.587691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:21.589370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-dafccdc8-f55e-410b-b819-831afc973527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.223229 Jul 01 07:09:21.590680 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 92/177] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:21 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:21.596590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c582a935-3916-4dd6-8cca-2212bf3b4c7e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:21.597403 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c582a935-3916-4dd6-8cca-2212bf3b4c7e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:21.605276 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c582a935-3916-4dd6-8cca-2212bf3b4c7e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:21.605914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c582a935-3916-4dd6-8cca-2212bf3b4c7e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:21.607074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c582a935-3916-4dd6-8cca-2212bf3b4c7e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:21.607510 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c582a935-3916-4dd6-8cca-2212bf3b4c7e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:21.609662 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1fe97a48-c6f2-464c-9832-7b1a2b8682dc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:21.619433 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1fe97a48-c6f2-464c-9832-7b1a2b8682dc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.223365 Jul 01 07:09:21.620480 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 86/178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:21 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:21.629445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:21.745389 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c582a935-3916-4dd6-8cca-2212bf3b4c7e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:21.752867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c582a935-3916-4dd6-8cca-2212bf3b4c7e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.160967 Jul 01 07:09:21.753433 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 93/179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:21 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:22.043745 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-dc5f6709-7be3-48d0-8b0a-12476cd94085 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:22.044350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-dc5f6709-7be3-48d0-8b0a-12476cd94085 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:22.050417 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc5f6709-7be3-48d0-8b0a-12476cd94085 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:22.051966 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc5f6709-7be3-48d0-8b0a-12476cd94085 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:22.051966 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc5f6709-7be3-48d0-8b0a-12476cd94085 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:22.052146 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc5f6709-7be3-48d0-8b0a-12476cd94085 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:22.246953 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-dc5f6709-7be3-48d0-8b0a-12476cd94085 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:22.254819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-dc5f6709-7be3-48d0-8b0a-12476cd94085 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.214792 Jul 01 07:09:22.255392 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 87/180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:22 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:22.608954 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:22.610369 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:22.616355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:22.616811 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:22.617572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:22.618009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:22.636823 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-dc65fb0b-5f83-4279-92cc-6a271df04d68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:22.637610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-dc65fb0b-5f83-4279-92cc-6a271df04d68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:22.644288 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc65fb0b-5f83-4279-92cc-6a271df04d68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:22.644736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc65fb0b-5f83-4279-92cc-6a271df04d68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:22.645504 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc65fb0b-5f83-4279-92cc-6a271df04d68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:22.645932 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc65fb0b-5f83-4279-92cc-6a271df04d68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:22.815228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:22.831513 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-dc65fb0b-5f83-4279-92cc-6a271df04d68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:22.835051 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:22.840491 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:22.842004 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:22.843145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f8bb4712-092f-4bc5-906b-1ec2bfd6c548 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.238841 Jul 01 07:09:22.847417 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-dc65fb0b-5f83-4279-92cc-6a271df04d68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.214420 Jul 01 07:09:22.848198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 88/181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:22 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:22.858797 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 94/182] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:22 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:22.858972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6ed71077-7ca9-4520-b28c-34f6712f2571 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:22.858972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6ed71077-7ca9-4520-b28c-34f6712f2571 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:22.859571 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6ed71077-7ca9-4520-b28c-34f6712f2571 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:22.860032 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6ed71077-7ca9-4520-b28c-34f6712f2571 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:22.861422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6ed71077-7ca9-4520-b28c-34f6712f2571 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:22.862078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6ed71077-7ca9-4520-b28c-34f6712f2571 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:23.003989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6ed71077-7ca9-4520-b28c-34f6712f2571 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:23.016900 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6ed71077-7ca9-4520-b28c-34f6712f2571 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.167169 Jul 01 07:09:23.025391 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 89/183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:22 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:23.270893 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-cf2e7024-57ab-4882-bc01-1d133989fc01 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:23.271504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-cf2e7024-57ab-4882-bc01-1d133989fc01 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:23.277392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cf2e7024-57ab-4882-bc01-1d133989fc01 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:23.277830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cf2e7024-57ab-4882-bc01-1d133989fc01 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:23.278583 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cf2e7024-57ab-4882-bc01-1d133989fc01 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:23.279028 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cf2e7024-57ab-4882-bc01-1d133989fc01 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:23.411106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-cf2e7024-57ab-4882-bc01-1d133989fc01 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:23.421521 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-cf2e7024-57ab-4882-bc01-1d133989fc01 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.154203 Jul 01 07:09:23.422103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 95/184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:23 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:23.867142 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-72e75110-6f47-4299-b701-53b9c3f4f0d1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:23.868292 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-72e75110-6f47-4299-b701-53b9c3f4f0d1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:23.868615 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:23.869392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:23.871350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=99 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:23.881866 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:23.882343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:23.882803 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-72e75110-6f47-4299-b701-53b9c3f4f0d1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:23.883359 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:23.884080 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:23.885240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-72e75110-6f47-4299-b701-53b9c3f4f0d1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:23.886225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-72e75110-6f47-4299-b701-53b9c3f4f0d1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:23.887335 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-72e75110-6f47-4299-b701-53b9c3f4f0d1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:24.200734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:24.217810 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:24.219350 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:24.221087 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4676738b-7f6a-46a5-aca5-6f9492784167 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.356577 Jul 01 07:09:24.223645 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 96/185] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:23 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:24.227621 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-72e75110-6f47-4299-b701-53b9c3f4f0d1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:24.228200 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-56d0668f-0128-40ff-8a10-bec4dd5803b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:24.228805 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-56d0668f-0128-40ff-8a10-bec4dd5803b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:24.237114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-56d0668f-0128-40ff-8a10-bec4dd5803b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:24.237533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-56d0668f-0128-40ff-8a10-bec4dd5803b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:24.248252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-56d0668f-0128-40ff-8a10-bec4dd5803b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:24.248252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-56d0668f-0128-40ff-8a10-bec4dd5803b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:24.248852 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-72e75110-6f47-4299-b701-53b9c3f4f0d1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.377286 Jul 01 07:09:24.265742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 90/186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:23 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:24.487060 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7e8d9e2c-7bc1-46f8-ae01-2e49fce4d577 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:24.487812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7e8d9e2c-7bc1-46f8-ae01-2e49fce4d577 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:24.511888 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7e8d9e2c-7bc1-46f8-ae01-2e49fce4d577 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:24.512345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7e8d9e2c-7bc1-46f8-ae01-2e49fce4d577 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:24.513276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7e8d9e2c-7bc1-46f8-ae01-2e49fce4d577 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:24.513710 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7e8d9e2c-7bc1-46f8-ae01-2e49fce4d577 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:25.035746 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7e8d9e2c-7bc1-46f8-ae01-2e49fce4d577 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:25.042518 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-56d0668f-0128-40ff-8a10-bec4dd5803b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:25.052610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7e8d9e2c-7bc1-46f8-ae01-2e49fce4d577 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.615196 Jul 01 07:09:25.053744 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-56d0668f-0128-40ff-8a10-bec4dd5803b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.828804 Jul 01 07:09:25.053899 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 91/187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:24 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:25.054189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 97/188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:24 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:25.122072 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-19e4e4df-ca1d-4408-8985-df7f697cc2e3 req-222cf6b3-4fa6-4e96-811b-b22d27a4edb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3445a4a9-908c-4f8d-a9f0-192f84c2158a", "name": "network-vif-plugged", "status": "completed", "tag": "4376d892-b82b-4683-8603-3bf6bc709973"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:25.133021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-19e4e4df-ca1d-4408-8985-df7f697cc2e3 req-222cf6b3-4fa6-4e96-811b-b22d27a4edb8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:25.133617 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-19e4e4df-ca1d-4408-8985-df7f697cc2e3 req-222cf6b3-4fa6-4e96-811b-b22d27a4edb8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:25.145357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-19e4e4df-ca1d-4408-8985-df7f697cc2e3 req-222cf6b3-4fa6-4e96-811b-b22d27a4edb8 service nova] Creating event network-vif-plugged:4376d892-b82b-4683-8603-3bf6bc709973 for instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a on hv-cinder-80721 Jul 01 07:09:25.151048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-19e4e4df-ca1d-4408-8985-df7f697cc2e3 req-222cf6b3-4fa6-4e96-811b-b22d27a4edb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033243 Jul 01 07:09:25.152095 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 92/189] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:25.242539 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:25.243623 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:25.251728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:25.252507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:25.253521 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:25.254204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:25.263442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-73fb0a25-a8fa-4fe4-9b3c-fa419ecc890a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:25.264215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-73fb0a25-a8fa-4fe4-9b3c-fa419ecc890a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:25.271091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73fb0a25-a8fa-4fe4-9b3c-fa419ecc890a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:25.274590 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73fb0a25-a8fa-4fe4-9b3c-fa419ecc890a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:25.275425 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73fb0a25-a8fa-4fe4-9b3c-fa419ecc890a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:25.275878 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73fb0a25-a8fa-4fe4-9b3c-fa419ecc890a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:25.494446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:25.496967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-73fb0a25-a8fa-4fe4-9b3c-fa419ecc890a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:25.503347 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:25.504877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:25.505987 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-43b70b82-45d0-4a05-bcde-2977da77a020 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.271217 Jul 01 07:09:25.509486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 98/190] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:25 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:25.519482 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-73fb0a25-a8fa-4fe4-9b3c-fa419ecc890a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.261366 Jul 01 07:09:25.520077 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 93/191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:25 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:26.074242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b0578dee-66e4-4be8-b2ed-0c192404df35 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:26.077781 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5badfe58-7bf3-4871-953b-9b32d22128ba tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:26.078420 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5badfe58-7bf3-4871-953b-9b32d22128ba tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:26.079023 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b0578dee-66e4-4be8-b2ed-0c192404df35 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:26.088496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b0578dee-66e4-4be8-b2ed-0c192404df35 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:26.088878 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b0578dee-66e4-4be8-b2ed-0c192404df35 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:26.089647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b0578dee-66e4-4be8-b2ed-0c192404df35 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:26.097057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5badfe58-7bf3-4871-953b-9b32d22128ba tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:26.097914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5badfe58-7bf3-4871-953b-9b32d22128ba tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:26.098953 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5badfe58-7bf3-4871-953b-9b32d22128ba tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:26.099658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b0578dee-66e4-4be8-b2ed-0c192404df35 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:26.104282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5badfe58-7bf3-4871-953b-9b32d22128ba tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:26.341983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b0578dee-66e4-4be8-b2ed-0c192404df35 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:26.345135 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5badfe58-7bf3-4871-953b-9b32d22128ba tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:26.353959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5badfe58-7bf3-4871-953b-9b32d22128ba tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1315 microversion: 2.1 time: 0.286986 Jul 01 07:09:26.355328 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 99/192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:26 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:26.359414 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b0578dee-66e4-4be8-b2ed-0c192404df35 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.287558 Jul 01 07:09:26.360737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 94/193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:26 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:26.525365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:26.526060 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:26.536110 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6b2e2f66-e96f-485a-849d-ca6c3dd63824 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:26.536711 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6b2e2f66-e96f-485a-849d-ca6c3dd63824 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:26.540336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:26.540788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:26.541573 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:26.546969 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:26.548914 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6b2e2f66-e96f-485a-849d-ca6c3dd63824 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:26.549365 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6b2e2f66-e96f-485a-849d-ca6c3dd63824 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:26.550148 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6b2e2f66-e96f-485a-849d-ca6c3dd63824 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:26.550583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6b2e2f66-e96f-485a-849d-ca6c3dd63824 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:26.857755 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:26.872305 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:26.873907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:26.875385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-76620222-035b-4ee1-a27f-cbaf05f0d17c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.353820 Jul 01 07:09:26.886244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 100/194] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:26 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:26.952605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6b2e2f66-e96f-485a-849d-ca6c3dd63824 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:26.960473 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6b2e2f66-e96f-485a-849d-ca6c3dd63824 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.428099 Jul 01 07:09:26.961164 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:26 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:27.177431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-9f86a219-3cb1-4bc3-93aa-969f880e0a97 req-db89897d-571b-4e53-98b7-2bd6da837fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15849f34-94b8-4797-b899-2c1e6ea4fb3d", "name": "network-vif-plugged", "status": "completed", "tag": "8bfa5bd3-77e4-4c39-a2bf-c0c691f11452"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:27.197687 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-9f86a219-3cb1-4bc3-93aa-969f880e0a97 req-db89897d-571b-4e53-98b7-2bd6da837fee service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.198273 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-9f86a219-3cb1-4bc3-93aa-969f880e0a97 req-db89897d-571b-4e53-98b7-2bd6da837fee service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:27.216057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-9f86a219-3cb1-4bc3-93aa-969f880e0a97 req-db89897d-571b-4e53-98b7-2bd6da837fee service nova] Creating event network-vif-plugged:8bfa5bd3-77e4-4c39-a2bf-c0c691f11452 for instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d on hv-cinder-80721 Jul 01 07:09:27.225866 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-9f86a219-3cb1-4bc3-93aa-969f880e0a97 req-db89897d-571b-4e53-98b7-2bd6da837fee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052493 Jul 01 07:09:27.232278 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 101/196] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:27.378801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b2f11be0-2acb-4c56-99ee-853eff79330c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:27.379673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b2f11be0-2acb-4c56-99ee-853eff79330c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:27.380456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e9daef1c-9128-4a8b-883f-3c5c1a43fdc6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:27.381189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e9daef1c-9128-4a8b-883f-3c5c1a43fdc6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:27.387431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b2f11be0-2acb-4c56-99ee-853eff79330c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.388437 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b2f11be0-2acb-4c56-99ee-853eff79330c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:27.389767 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b2f11be0-2acb-4c56-99ee-853eff79330c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.390446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b2f11be0-2acb-4c56-99ee-853eff79330c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:27.394914 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e9daef1c-9128-4a8b-883f-3c5c1a43fdc6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.395636 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e9daef1c-9128-4a8b-883f-3c5c1a43fdc6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:27.396568 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e9daef1c-9128-4a8b-883f-3c5c1a43fdc6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.397434 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e9daef1c-9128-4a8b-883f-3c5c1a43fdc6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:27.738024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b2f11be0-2acb-4c56-99ee-853eff79330c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:27.748639 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b2f11be0-2acb-4c56-99ee-853eff79330c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1366 microversion: 2.1 time: 0.375265 Jul 01 07:09:27.753417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 102/197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:27 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:27.894081 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:27.894878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:27.904638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.908655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:27.909708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.910353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:27.955466 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e9daef1c-9128-4a8b-883f-3c5c1a43fdc6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:27.963807 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e9daef1c-9128-4a8b-883f-3c5c1a43fdc6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1501 microversion: 2.1 time: 0.591975 Jul 01 07:09:27.964395 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 96/198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:27 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1501 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:27.980824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d239c46b-519e-4a08-8871-91f02510bdee tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:27.981436 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d239c46b-519e-4a08-8871-91f02510bdee tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:27.989071 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d239c46b-519e-4a08-8871-91f02510bdee tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.989523 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d239c46b-519e-4a08-8871-91f02510bdee tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:27.990297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d239c46b-519e-4a08-8871-91f02510bdee tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:27.990730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d239c46b-519e-4a08-8871-91f02510bdee tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:28.257556 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d239c46b-519e-4a08-8871-91f02510bdee tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:28.269350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d239c46b-519e-4a08-8871-91f02510bdee tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.291319 Jul 01 07:09:28.271403 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 97/199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:27 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:28.278304 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:28.287741 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:28.289634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:28.290097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6a36b663-ccdf-4c1c-9fa2-f07560e66bff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.400718 Jul 01 07:09:28.301287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 103/200] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:27 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:28.771010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-58a76703-5bb6-4000-89bf-e675dc566cd4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:28.772215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-58a76703-5bb6-4000-89bf-e675dc566cd4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:28.779247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-58a76703-5bb6-4000-89bf-e675dc566cd4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:28.780529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-58a76703-5bb6-4000-89bf-e675dc566cd4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:28.782606 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-58a76703-5bb6-4000-89bf-e675dc566cd4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:28.783081 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-58a76703-5bb6-4000-89bf-e675dc566cd4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:28.947313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-58a76703-5bb6-4000-89bf-e675dc566cd4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:28.956261 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-58a76703-5bb6-4000-89bf-e675dc566cd4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1556 microversion: 2.1 time: 0.190530 Jul 01 07:09:28.957216 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 98/201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:28 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:28.973196 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a1d58239-0581-4aee-b4a9-7807f99494a4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:28.973680 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a1d58239-0581-4aee-b4a9-7807f99494a4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:28.980204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a1d58239-0581-4aee-b4a9-7807f99494a4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:28.980652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a1d58239-0581-4aee-b4a9-7807f99494a4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:28.981540 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a1d58239-0581-4aee-b4a9-7807f99494a4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:28.981970 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a1d58239-0581-4aee-b4a9-7807f99494a4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:29.123518 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a1d58239-0581-4aee-b4a9-7807f99494a4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146214 Jul 01 07:09:29.123518 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 104/202] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jul 1 07:09:28 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:29.289254 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5aa4050d-9a3d-4cdb-af8c-ef83aba64f99 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:29.289861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5aa4050d-9a3d-4cdb-af8c-ef83aba64f99 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:29.296809 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5aa4050d-9a3d-4cdb-af8c-ef83aba64f99 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:29.297580 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5aa4050d-9a3d-4cdb-af8c-ef83aba64f99 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:29.298963 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5aa4050d-9a3d-4cdb-af8c-ef83aba64f99 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:29.299579 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5aa4050d-9a3d-4cdb-af8c-ef83aba64f99 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:29.320701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:29.321332 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:29.343465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:29.344122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:29.345110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:29.345604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:29.671690 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:29.681412 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:29.688868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:29.693145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-dd56e40e-3fe5-4464-bf4f-ac4c7169d6ef tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.376084 Jul 01 07:09:29.693994 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 105/203] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:29 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:09:29.695455 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5aa4050d-9a3d-4cdb-af8c-ef83aba64f99 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:29.711766 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5aa4050d-9a3d-4cdb-af8c-ef83aba64f99 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.426610 Jul 01 07:09:29.713149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 99/204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:29 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:30.715781 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:30.717834 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:30.729863 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-337b51e3-197e-47c0-834a-18338fb281c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:30.732087 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-337b51e3-197e-47c0-834a-18338fb281c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:30.741684 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:30.744391 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-337b51e3-197e-47c0-834a-18338fb281c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:30.745186 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-337b51e3-197e-47c0-834a-18338fb281c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:30.746436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:30.747345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-337b51e3-197e-47c0-834a-18338fb281c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:30.748788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:30.749008 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-337b51e3-197e-47c0-834a-18338fb281c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:30.750483 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:31.235257 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-337b51e3-197e-47c0-834a-18338fb281c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:31.236815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:31.244941 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:31.245748 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-337b51e3-197e-47c0-834a-18338fb281c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.518032 Jul 01 07:09:31.247563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 100/205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:30 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:31.257091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-be7a1b7b-c8f2-49a9-b53c-dc9435ac09ab tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53c2b12f-041a-424c-bc2b-0d4e08801c9b"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:31.259097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:31.260430 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-af333b2d-87f0-4938-820a-0660ffb4d618 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.552783 Jul 01 07:09:31.261469 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-be7a1b7b-c8f2-49a9-b53c-dc9435ac09ab tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:31.272798 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-be7a1b7b-c8f2-49a9-b53c-dc9435ac09ab tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:31.273519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-be7a1b7b-c8f2-49a9-b53c-dc9435ac09ab tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:31.274583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-be7a1b7b-c8f2-49a9-b53c-dc9435ac09ab tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:31.275279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-be7a1b7b-c8f2-49a9-b53c-dc9435ac09ab tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:31.275444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 106/206] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:30 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:31.283407 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-abec754a-798a-42f4-8b49-2830b966288a req-163b0b90-9bd9-465a-a255-52e595a93b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587ab81f-e92f-455f-8cc0-09463978813d", "tag": "078a7f98-f4b7-4477-a055-a3fb79cc3fa2"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:31.304021 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-abec754a-798a-42f4-8b49-2830b966288a req-163b0b90-9bd9-465a-a255-52e595a93b12 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:31.304467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-abec754a-798a-42f4-8b49-2830b966288a req-163b0b90-9bd9-465a-a255-52e595a93b12 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:31.318697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-abec754a-798a-42f4-8b49-2830b966288a req-163b0b90-9bd9-465a-a255-52e595a93b12 service nova] Creating event network-changed:078a7f98-f4b7-4477-a055-a3fb79cc3fa2 for instance 587ab81f-e92f-455f-8cc0-09463978813d on hv-cinder-80721 Jul 01 07:09:31.352976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-abec754a-798a-42f4-8b49-2830b966288a req-163b0b90-9bd9-465a-a255-52e595a93b12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063825 Jul 01 07:09:31.361714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 107/207] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:32.269078 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-41876f6e-a1d5-42b7-bb27-2ed7b72fa144 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:32.269804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-41876f6e-a1d5-42b7-bb27-2ed7b72fa144 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:32.281619 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-41876f6e-a1d5-42b7-bb27-2ed7b72fa144 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:32.282387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-41876f6e-a1d5-42b7-bb27-2ed7b72fa144 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:32.283467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-41876f6e-a1d5-42b7-bb27-2ed7b72fa144 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:32.283997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-41876f6e-a1d5-42b7-bb27-2ed7b72fa144 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:32.508649 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-41876f6e-a1d5-42b7-bb27-2ed7b72fa144 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:32.520402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-41876f6e-a1d5-42b7-bb27-2ed7b72fa144 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1321 microversion: 2.1 time: 0.257360 Jul 01 07:09:32.520979 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 108/208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:32 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:32.527441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:32.528044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:32.534279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:32.534798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:32.535613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:32.536041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:32.698164 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:32.709020 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:32.711561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:32.712969 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-45de94c8-72a8-4235-8182-baa54ed6b7d3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.191090 Jul 01 07:09:32.714077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 109/209] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:32 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:33.078428 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-21bb6e88-5a1e-40e1-bcf5-0579c30cd327 req-ec5eea58-e8f5-47ac-82ca-ede53d156eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e3db32-ed35-4c27-ad2f-30bfbe556c25", "name": "network-vif-plugged", "status": "completed", "tag": "37b4518e-4b3f-4f6d-9030-a07d10ba59c5"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:33.091745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-21bb6e88-5a1e-40e1-bcf5-0579c30cd327 req-ec5eea58-e8f5-47ac-82ca-ede53d156eb6 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:33.092849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-21bb6e88-5a1e-40e1-bcf5-0579c30cd327 req-ec5eea58-e8f5-47ac-82ca-ede53d156eb6 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:33.110988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-21bb6e88-5a1e-40e1-bcf5-0579c30cd327 req-ec5eea58-e8f5-47ac-82ca-ede53d156eb6 service nova] Creating event network-vif-plugged:37b4518e-4b3f-4f6d-9030-a07d10ba59c5 for instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 on hv-cinder-80721 Jul 01 07:09:33.117661 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-21bb6e88-5a1e-40e1-bcf5-0579c30cd327 req-ec5eea58-e8f5-47ac-82ca-ede53d156eb6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046546 Jul 01 07:09:33.118906 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 110/210] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:09:33.128773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-be7a1b7b-c8f2-49a9-b53c-dc9435ac09ab tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "POST /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.879218 Jul 01 07:09:33.131357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 101/211] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:09:31 2022] POST /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8/os-volume_attachments => generated 194 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:09:33.538717 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-97fd00a6-bb1c-409d-8a0b-8234c1d172dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:33.539381 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-97fd00a6-bb1c-409d-8a0b-8234c1d172dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:33.546474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-97fd00a6-bb1c-409d-8a0b-8234c1d172dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:33.547002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-97fd00a6-bb1c-409d-8a0b-8234c1d172dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:33.548604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-97fd00a6-bb1c-409d-8a0b-8234c1d172dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:33.549195 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-97fd00a6-bb1c-409d-8a0b-8234c1d172dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:33.731079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:33.731776 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:33.743299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:33.743752 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:33.744540 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:33.745020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:33.862070 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-97fd00a6-bb1c-409d-8a0b-8234c1d172dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:33.871466 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-97fd00a6-bb1c-409d-8a0b-8234c1d172dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1516 microversion: 2.1 time: 0.337298 Jul 01 07:09:33.872156 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 111/212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:33 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1516 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:33.892066 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b7112f9f-047b-4f2e-a767-ac6ddf1d3018 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:33.893161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b7112f9f-047b-4f2e-a767-ac6ddf1d3018 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:33.901085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7112f9f-047b-4f2e-a767-ac6ddf1d3018 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:33.901825 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7112f9f-047b-4f2e-a767-ac6ddf1d3018 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:33.903030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7112f9f-047b-4f2e-a767-ac6ddf1d3018 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:33.903863 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7112f9f-047b-4f2e-a767-ac6ddf1d3018 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:33.926977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:33.930261 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:33.936895 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-b7112f9f-047b-4f2e-a767-ac6ddf1d3018 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lazy-loading 'flavor' on Instance uuid 15849f34-94b8-4797-b899-2c1e6ea4fb3d {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:09:33.940009 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:33.942182 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:33.943797 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0a0c4c2c-5c15-4474-8784-92a989b71e76 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.217106 Jul 01 07:09:33.944506 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 102/213] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:33 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:09:34.079024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b7112f9f-047b-4f2e-a767-ac6ddf1d3018 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d/action" status: 200 len: 32 microversion: 2.1 time: 0.193401 Jul 01 07:09:34.083430 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 112/214] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:09:33 2022] POST /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 07:09:34.092150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-293f972d-cc26-4920-ad98-0cf26d8f8b57 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:34.092867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-293f972d-cc26-4920-ad98-0cf26d8f8b57 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:34.099579 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-293f972d-cc26-4920-ad98-0cf26d8f8b57 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:34.100180 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-293f972d-cc26-4920-ad98-0cf26d8f8b57 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:34.101014 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-293f972d-cc26-4920-ad98-0cf26d8f8b57 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:34.101462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-293f972d-cc26-4920-ad98-0cf26d8f8b57 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:34.292898 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-293f972d-cc26-4920-ad98-0cf26d8f8b57 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:34.304275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-293f972d-cc26-4920-ad98-0cf26d8f8b57 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.216186 Jul 01 07:09:34.307876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 103/215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:34 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:34.962234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:34.962739 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:34.977346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:34.977813 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:34.978612 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:34.980405 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:35.326477 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a9fdd68f-82dd-4831-afe1-4a2a68d66041 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:35.327218 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a9fdd68f-82dd-4831-afe1-4a2a68d66041 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:35.337411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a9fdd68f-82dd-4831-afe1-4a2a68d66041 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:35.337823 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a9fdd68f-82dd-4831-afe1-4a2a68d66041 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:35.338600 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a9fdd68f-82dd-4831-afe1-4a2a68d66041 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:35.339063 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a9fdd68f-82dd-4831-afe1-4a2a68d66041 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:35.387593 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:35.400650 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:35.403712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:35.405782 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f4f4b302-1b9e-4c6c-b095-9a6676d33bac tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.447715 Jul 01 07:09:35.420951 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 113/216] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:34 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:35.650403 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a9fdd68f-82dd-4831-afe1-4a2a68d66041 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:35.655167 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:35.662039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a9fdd68f-82dd-4831-afe1-4a2a68d66041 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.340476 Jul 01 07:09:35.663050 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 104/217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:35 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:36.426258 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:36.426899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:36.435910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:36.436364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:36.437146 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:36.437599 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:36.679747 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1cfbeaa8-472f-40da-b043-b41642e9185e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:36.681241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1cfbeaa8-472f-40da-b043-b41642e9185e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:36.689796 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cfbeaa8-472f-40da-b043-b41642e9185e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:36.690473 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cfbeaa8-472f-40da-b043-b41642e9185e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:36.691291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cfbeaa8-472f-40da-b043-b41642e9185e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:36.691729 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cfbeaa8-472f-40da-b043-b41642e9185e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:36.755252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:36.767364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:36.769172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:36.770953 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9ce8fb13-c9cd-4f80-bc9a-6547d8f31ebd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1408 microversion: 2.20 time: 0.350275 Jul 01 07:09:36.772450 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 114/218] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:36 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1408 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:36.970221 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1cfbeaa8-472f-40da-b043-b41642e9185e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:36.983154 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1cfbeaa8-472f-40da-b043-b41642e9185e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.306713 Jul 01 07:09:36.986690 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 105/219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:36 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:37.789646 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:37.790457 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:37.797089 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:37.797595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:37.798329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:37.798884 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:37.941395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:37.950411 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:37.952035 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:37.953259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c5d2e18d-acbc-4905-9cd8-fe6c9042e932 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1601 microversion: 2.20 time: 0.167443 Jul 01 07:09:37.953835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 115/220] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:09:37 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:09:37.972363 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-15b4ed16-5ed0-4f3a-bfd6-c4257548a02c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:37.973492 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-15b4ed16-5ed0-4f3a-bfd6-c4257548a02c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:37.980172 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-15b4ed16-5ed0-4f3a-bfd6-c4257548a02c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:37.980790 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-15b4ed16-5ed0-4f3a-bfd6-c4257548a02c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:37.981560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-15b4ed16-5ed0-4f3a-bfd6-c4257548a02c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:37.982141 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-15b4ed16-5ed0-4f3a-bfd6-c4257548a02c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:38.006174 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f9676f71-ca30-429d-aed1-4702eb25459a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:38.007116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f9676f71-ca30-429d-aed1-4702eb25459a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:38.018547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9676f71-ca30-429d-aed1-4702eb25459a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:38.019017 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9676f71-ca30-429d-aed1-4702eb25459a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:38.019803 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9676f71-ca30-429d-aed1-4702eb25459a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:38.020304 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9676f71-ca30-429d-aed1-4702eb25459a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:38.098021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-15b4ed16-5ed0-4f3a-bfd6-c4257548a02c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130213 Jul 01 07:09:38.098620 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 106/221] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jul 1 07:09:37 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:09:38.242132 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f9676f71-ca30-429d-aed1-4702eb25459a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:38.251490 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f9676f71-ca30-429d-aed1-4702eb25459a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.253874 Jul 01 07:09:38.253624 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 116/222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:37 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:09:39.271701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e476cc27-34e1-456e-825f-8d6f405f1763 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:39.272223 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e476cc27-34e1-456e-825f-8d6f405f1763 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:39.282377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e476cc27-34e1-456e-825f-8d6f405f1763 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:39.285481 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e476cc27-34e1-456e-825f-8d6f405f1763 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:39.287629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e476cc27-34e1-456e-825f-8d6f405f1763 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:39.288232 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e476cc27-34e1-456e-825f-8d6f405f1763 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:39.410972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-1fcb67f4-a65b-4ae9-b5c3-e510626c42c7 req-849cd3bf-ae45-4aed-8492-8171aaba42d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e3db32-ed35-4c27-ad2f-30bfbe556c25", "tag": "37b4518e-4b3f-4f6d-9030-a07d10ba59c5"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:09:39.419135 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-1fcb67f4-a65b-4ae9-b5c3-e510626c42c7 req-849cd3bf-ae45-4aed-8492-8171aaba42d8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:39.419577 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-1fcb67f4-a65b-4ae9-b5c3-e510626c42c7 req-849cd3bf-ae45-4aed-8492-8171aaba42d8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:39.439477 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-1fcb67f4-a65b-4ae9-b5c3-e510626c42c7 req-849cd3bf-ae45-4aed-8492-8171aaba42d8 service nova] Creating event network-changed:37b4518e-4b3f-4f6d-9030-a07d10ba59c5 for instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 on hv-cinder-80721 Jul 01 07:09:39.445729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-1fcb67f4-a65b-4ae9-b5c3-e510626c42c7 req-849cd3bf-ae45-4aed-8492-8171aaba42d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037950 Jul 01 07:09:39.446708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 117/223] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:09:39.526828 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e476cc27-34e1-456e-825f-8d6f405f1763 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:39.537932 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e476cc27-34e1-456e-825f-8d6f405f1763 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.272292 Jul 01 07:09:39.550672 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 107/224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:39 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:40.561616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-66c02dda-881c-4f79-95b5-44182186d185 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:40.564140 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-66c02dda-881c-4f79-95b5-44182186d185 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:40.574122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66c02dda-881c-4f79-95b5-44182186d185 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:40.574789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66c02dda-881c-4f79-95b5-44182186d185 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:40.575828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66c02dda-881c-4f79-95b5-44182186d185 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:40.576683 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66c02dda-881c-4f79-95b5-44182186d185 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:40.765655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-66c02dda-881c-4f79-95b5-44182186d185 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:40.774004 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-66c02dda-881c-4f79-95b5-44182186d185 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.219539 Jul 01 07:09:40.775138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 118/225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:40 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:41.792084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1bcf8738-3cac-4b44-82d9-29e6addb9a2b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:41.792706 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1bcf8738-3cac-4b44-82d9-29e6addb9a2b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:41.799392 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1bcf8738-3cac-4b44-82d9-29e6addb9a2b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:41.799838 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1bcf8738-3cac-4b44-82d9-29e6addb9a2b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:41.800594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1bcf8738-3cac-4b44-82d9-29e6addb9a2b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:41.801021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1bcf8738-3cac-4b44-82d9-29e6addb9a2b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:41.937049 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1bcf8738-3cac-4b44-82d9-29e6addb9a2b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:41.944909 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1bcf8738-3cac-4b44-82d9-29e6addb9a2b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.156630 Jul 01 07:09:41.945465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 108/226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:41 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:42.961233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b594e619-9314-41e7-8ce0-b00e9dc8dfe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:42.961838 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b594e619-9314-41e7-8ce0-b00e9dc8dfe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:42.967959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b594e619-9314-41e7-8ce0-b00e9dc8dfe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:42.968337 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b594e619-9314-41e7-8ce0-b00e9dc8dfe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:42.969140 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b594e619-9314-41e7-8ce0-b00e9dc8dfe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:42.970082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b594e619-9314-41e7-8ce0-b00e9dc8dfe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:43.111330 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b594e619-9314-41e7-8ce0-b00e9dc8dfe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:43.119024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b594e619-9314-41e7-8ce0-b00e9dc8dfe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.161555 Jul 01 07:09:43.119588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 119/227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:42 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:44.135961 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5562bedb-1cd4-4ee9-a735-172dd975ce64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:44.136756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5562bedb-1cd4-4ee9-a735-172dd975ce64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:44.145593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5562bedb-1cd4-4ee9-a735-172dd975ce64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:44.145790 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5562bedb-1cd4-4ee9-a735-172dd975ce64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:44.146942 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5562bedb-1cd4-4ee9-a735-172dd975ce64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:44.155281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5562bedb-1cd4-4ee9-a735-172dd975ce64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:44.279618 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5562bedb-1cd4-4ee9-a735-172dd975ce64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:44.287472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5562bedb-1cd4-4ee9-a735-172dd975ce64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.155235 Jul 01 07:09:44.288047 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 109/228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:44 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:45.304009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-29235317-73ec-4de9-85e2-00d8f2f8f107 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:45.304549 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-29235317-73ec-4de9-85e2-00d8f2f8f107 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:45.310990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-29235317-73ec-4de9-85e2-00d8f2f8f107 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:45.311437 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-29235317-73ec-4de9-85e2-00d8f2f8f107 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:45.312190 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-29235317-73ec-4de9-85e2-00d8f2f8f107 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:45.312678 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-29235317-73ec-4de9-85e2-00d8f2f8f107 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:45.446488 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-29235317-73ec-4de9-85e2-00d8f2f8f107 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:45.454860 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-29235317-73ec-4de9-85e2-00d8f2f8f107 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.154748 Jul 01 07:09:45.455426 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 120/229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:45 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:46.472513 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3302148b-4c25-4408-b99c-0c015dd0e6a2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:46.473055 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3302148b-4c25-4408-b99c-0c015dd0e6a2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:46.479422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3302148b-4c25-4408-b99c-0c015dd0e6a2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:46.479865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3302148b-4c25-4408-b99c-0c015dd0e6a2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:46.480612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3302148b-4c25-4408-b99c-0c015dd0e6a2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:46.481039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3302148b-4c25-4408-b99c-0c015dd0e6a2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:46.605567 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3302148b-4c25-4408-b99c-0c015dd0e6a2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:46.613563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3302148b-4c25-4408-b99c-0c015dd0e6a2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.145601 Jul 01 07:09:46.614120 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 110/230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:46 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:47.629884 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c5486293-8c80-483f-b1dc-b9d6260c9675 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:47.630486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c5486293-8c80-483f-b1dc-b9d6260c9675 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:47.636403 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c5486293-8c80-483f-b1dc-b9d6260c9675 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:47.636851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c5486293-8c80-483f-b1dc-b9d6260c9675 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:47.637598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c5486293-8c80-483f-b1dc-b9d6260c9675 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:47.638037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c5486293-8c80-483f-b1dc-b9d6260c9675 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:47.766557 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c5486293-8c80-483f-b1dc-b9d6260c9675 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:47.774058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c5486293-8c80-483f-b1dc-b9d6260c9675 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.148576 Jul 01 07:09:47.774596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 121/231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:47 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:48.280831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4cb40c0c-de57-47df-bff6-765624469f34 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:48.281379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4cb40c0c-de57-47df-bff6-765624469f34 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:48.288556 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cb40c0c-de57-47df-bff6-765624469f34 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:48.289008 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cb40c0c-de57-47df-bff6-765624469f34 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:48.289770 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cb40c0c-de57-47df-bff6-765624469f34 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:48.290204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cb40c0c-de57-47df-bff6-765624469f34 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:48.316291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4cb40c0c-de57-47df-bff6-765624469f34 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:09:48.408725 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4cb40c0c-de57-47df-bff6-765624469f34 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "DELETE /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 204 len: 0 microversion: 2.1 time: 0.131282 Jul 01 07:09:48.409322 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 111/232] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:09:48 2022] DELETE /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:09:48.417641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-da8abbf5-33b6-4cbf-a4cf-ed1cafb5e034 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:48.418256 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-da8abbf5-33b6-4cbf-a4cf-ed1cafb5e034 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:48.420261 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=72 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:48.425871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-da8abbf5-33b6-4cbf-a4cf-ed1cafb5e034 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:48.426251 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-da8abbf5-33b6-4cbf-a4cf-ed1cafb5e034 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:48.427049 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-da8abbf5-33b6-4cbf-a4cf-ed1cafb5e034 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:48.427486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-da8abbf5-33b6-4cbf-a4cf-ed1cafb5e034 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:48.551694 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-da8abbf5-33b6-4cbf-a4cf-ed1cafb5e034 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:48.559745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-da8abbf5-33b6-4cbf-a4cf-ed1cafb5e034 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.145753 Jul 01 07:09:48.560314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 122/233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:48 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:48.791832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-654ca09b-af90-44bd-b351-cff29eb441de tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:48.792456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-654ca09b-af90-44bd-b351-cff29eb441de tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:48.798460 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-654ca09b-af90-44bd-b351-cff29eb441de tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:48.798948 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-654ca09b-af90-44bd-b351-cff29eb441de tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:48.799716 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-654ca09b-af90-44bd-b351-cff29eb441de tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:48.800157 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-654ca09b-af90-44bd-b351-cff29eb441de tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:48.926938 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-654ca09b-af90-44bd-b351-cff29eb441de tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:48.934574 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-654ca09b-af90-44bd-b351-cff29eb441de tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.146761 Jul 01 07:09:48.935179 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 112/234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:48 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:49.576793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-67b4bcc8-7171-4e95-af92-1d95dca2eb00 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:49.577403 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-67b4bcc8-7171-4e95-af92-1d95dca2eb00 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:49.583525 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-67b4bcc8-7171-4e95-af92-1d95dca2eb00 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:49.583973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-67b4bcc8-7171-4e95-af92-1d95dca2eb00 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:49.584726 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-67b4bcc8-7171-4e95-af92-1d95dca2eb00 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:49.585159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-67b4bcc8-7171-4e95-af92-1d95dca2eb00 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:49.714041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-67b4bcc8-7171-4e95-af92-1d95dca2eb00 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:49.722366 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-67b4bcc8-7171-4e95-af92-1d95dca2eb00 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.149398 Jul 01 07:09:49.722954 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 123/235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:49 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:49.951640 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e8367162-b730-48c2-a9b5-add1b084c9d2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:49.952199 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e8367162-b730-48c2-a9b5-add1b084c9d2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:49.959081 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8367162-b730-48c2-a9b5-add1b084c9d2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:49.959537 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8367162-b730-48c2-a9b5-add1b084c9d2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:49.960328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8367162-b730-48c2-a9b5-add1b084c9d2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:49.960776 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8367162-b730-48c2-a9b5-add1b084c9d2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:50.090664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e8367162-b730-48c2-a9b5-add1b084c9d2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:50.098129 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e8367162-b730-48c2-a9b5-add1b084c9d2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.150369 Jul 01 07:09:50.098721 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 113/236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:49 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:50.738939 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-40d98f54-40a9-48b6-861d-201d5cbff38c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:50.739493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-40d98f54-40a9-48b6-861d-201d5cbff38c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:50.745420 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40d98f54-40a9-48b6-861d-201d5cbff38c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:50.745868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40d98f54-40a9-48b6-861d-201d5cbff38c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:50.746623 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40d98f54-40a9-48b6-861d-201d5cbff38c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:50.747086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40d98f54-40a9-48b6-861d-201d5cbff38c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:50.873530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-40d98f54-40a9-48b6-861d-201d5cbff38c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:50.881373 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-40d98f54-40a9-48b6-861d-201d5cbff38c tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.146926 Jul 01 07:09:50.881936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 124/237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:50 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:51.115477 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-60e3a059-0b1d-4fba-a34f-5feaee40f054 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:51.116096 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-60e3a059-0b1d-4fba-a34f-5feaee40f054 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:51.122503 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-60e3a059-0b1d-4fba-a34f-5feaee40f054 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:51.122994 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-60e3a059-0b1d-4fba-a34f-5feaee40f054 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:51.123756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-60e3a059-0b1d-4fba-a34f-5feaee40f054 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:51.124196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-60e3a059-0b1d-4fba-a34f-5feaee40f054 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:51.253981 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-60e3a059-0b1d-4fba-a34f-5feaee40f054 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:51.261360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-60e3a059-0b1d-4fba-a34f-5feaee40f054 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.149778 Jul 01 07:09:51.261932 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 114/238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:51 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:51.898344 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fadf798e-ff8a-406d-8704-718e9bd945f6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:51.899012 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fadf798e-ff8a-406d-8704-718e9bd945f6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:51.904948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fadf798e-ff8a-406d-8704-718e9bd945f6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:51.905393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fadf798e-ff8a-406d-8704-718e9bd945f6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:51.906189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fadf798e-ff8a-406d-8704-718e9bd945f6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:51.906679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fadf798e-ff8a-406d-8704-718e9bd945f6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:52.033116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fadf798e-ff8a-406d-8704-718e9bd945f6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:52.041132 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fadf798e-ff8a-406d-8704-718e9bd945f6 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.146642 Jul 01 07:09:52.041693 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 125/239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:51 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:52.278684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4a1e66c6-26e9-40c7-bf9f-e6d3a27966e7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:52.279344 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4a1e66c6-26e9-40c7-bf9f-e6d3a27966e7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:52.286305 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4a1e66c6-26e9-40c7-bf9f-e6d3a27966e7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:52.286749 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4a1e66c6-26e9-40c7-bf9f-e6d3a27966e7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:52.287532 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4a1e66c6-26e9-40c7-bf9f-e6d3a27966e7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:52.287965 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4a1e66c6-26e9-40c7-bf9f-e6d3a27966e7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:52.417612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4a1e66c6-26e9-40c7-bf9f-e6d3a27966e7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:52.425700 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4a1e66c6-26e9-40c7-bf9f-e6d3a27966e7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.150822 Jul 01 07:09:52.426273 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 115/240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:52 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:53.058812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-895bfb1c-f0b8-4905-b5e7-bf1457ce056f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:53.059747 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-895bfb1c-f0b8-4905-b5e7-bf1457ce056f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:53.066102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-895bfb1c-f0b8-4905-b5e7-bf1457ce056f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:53.066538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-895bfb1c-f0b8-4905-b5e7-bf1457ce056f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:53.067463 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-895bfb1c-f0b8-4905-b5e7-bf1457ce056f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:53.067867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-895bfb1c-f0b8-4905-b5e7-bf1457ce056f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:53.208389 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-895bfb1c-f0b8-4905-b5e7-bf1457ce056f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:53.218382 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-895bfb1c-f0b8-4905-b5e7-bf1457ce056f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.163341 Jul 01 07:09:53.219511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 126/241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:53 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:53.443067 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6235cc6b-bdab-4dd3-9700-84dc8ce98609 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:53.443680 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6235cc6b-bdab-4dd3-9700-84dc8ce98609 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:53.450217 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6235cc6b-bdab-4dd3-9700-84dc8ce98609 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:53.450662 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6235cc6b-bdab-4dd3-9700-84dc8ce98609 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:53.451454 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6235cc6b-bdab-4dd3-9700-84dc8ce98609 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:53.451917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6235cc6b-bdab-4dd3-9700-84dc8ce98609 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:53.583879 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6235cc6b-bdab-4dd3-9700-84dc8ce98609 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:53.591347 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6235cc6b-bdab-4dd3-9700-84dc8ce98609 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.152163 Jul 01 07:09:53.591911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 116/242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:53 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:54.237122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-276fc7b7-9c00-4715-be0c-bd372a81fe92 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:54.237873 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-276fc7b7-9c00-4715-be0c-bd372a81fe92 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:54.244532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-276fc7b7-9c00-4715-be0c-bd372a81fe92 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:54.244977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-276fc7b7-9c00-4715-be0c-bd372a81fe92 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:54.245759 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-276fc7b7-9c00-4715-be0c-bd372a81fe92 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:54.246187 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-276fc7b7-9c00-4715-be0c-bd372a81fe92 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:54.378053 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-276fc7b7-9c00-4715-be0c-bd372a81fe92 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:54.381493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:54.387164 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-276fc7b7-9c00-4715-be0c-bd372a81fe92 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.154688 Jul 01 07:09:54.387734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 127/243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:54 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:54.608444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7b06a24e-5e65-414b-8afa-e530dc93bdf4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:54.609052 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7b06a24e-5e65-414b-8afa-e530dc93bdf4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:54.611560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:54.616899 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7b06a24e-5e65-414b-8afa-e530dc93bdf4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:54.617354 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7b06a24e-5e65-414b-8afa-e530dc93bdf4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:54.618124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7b06a24e-5e65-414b-8afa-e530dc93bdf4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:54.618569 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7b06a24e-5e65-414b-8afa-e530dc93bdf4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:54.757456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7b06a24e-5e65-414b-8afa-e530dc93bdf4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:54.764979 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7b06a24e-5e65-414b-8afa-e530dc93bdf4 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.160385 Jul 01 07:09:54.766189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 117/244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:54 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:55.404440 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fba27323-80dc-40db-a311-863375082460 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:55.405045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fba27323-80dc-40db-a311-863375082460 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:55.413424 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fba27323-80dc-40db-a311-863375082460 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:55.413918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fba27323-80dc-40db-a311-863375082460 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:55.414674 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fba27323-80dc-40db-a311-863375082460 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:55.415124 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fba27323-80dc-40db-a311-863375082460 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:55.539077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fba27323-80dc-40db-a311-863375082460 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:55.547543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fba27323-80dc-40db-a311-863375082460 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.146276 Jul 01 07:09:55.548097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 128/245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:55 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:55.783527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-73ec80e2-467c-48b7-aca3-4b6f77b2af2d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:55.784130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-73ec80e2-467c-48b7-aca3-4b6f77b2af2d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:55.790379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73ec80e2-467c-48b7-aca3-4b6f77b2af2d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:55.790852 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73ec80e2-467c-48b7-aca3-4b6f77b2af2d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:55.791602 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73ec80e2-467c-48b7-aca3-4b6f77b2af2d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:55.792033 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73ec80e2-467c-48b7-aca3-4b6f77b2af2d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:55.918198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-73ec80e2-467c-48b7-aca3-4b6f77b2af2d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:55.926087 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-73ec80e2-467c-48b7-aca3-4b6f77b2af2d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.147144 Jul 01 07:09:55.926654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 118/246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:55 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:56.564758 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a0a618e9-7b17-4877-bb81-631b9e9d3f8a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:56.565293 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a0a618e9-7b17-4877-bb81-631b9e9d3f8a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:56.571334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a0a618e9-7b17-4877-bb81-631b9e9d3f8a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:56.571782 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a0a618e9-7b17-4877-bb81-631b9e9d3f8a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:56.572547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a0a618e9-7b17-4877-bb81-631b9e9d3f8a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:56.572982 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a0a618e9-7b17-4877-bb81-631b9e9d3f8a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:56.695870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a0a618e9-7b17-4877-bb81-631b9e9d3f8a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:56.705259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a0a618e9-7b17-4877-bb81-631b9e9d3f8a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.144420 Jul 01 07:09:56.705822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 129/247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:56 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:56.943540 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1fff26b6-8b31-46cc-9914-2c8fa3e59aef tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:56.944176 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1fff26b6-8b31-46cc-9914-2c8fa3e59aef tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:56.950543 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1fff26b6-8b31-46cc-9914-2c8fa3e59aef tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:56.951031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1fff26b6-8b31-46cc-9914-2c8fa3e59aef tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:56.951791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1fff26b6-8b31-46cc-9914-2c8fa3e59aef tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:56.952227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1fff26b6-8b31-46cc-9914-2c8fa3e59aef tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:57.080362 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1fff26b6-8b31-46cc-9914-2c8fa3e59aef tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:57.087792 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1fff26b6-8b31-46cc-9914-2c8fa3e59aef tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.148069 Jul 01 07:09:57.088354 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 119/248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:56 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:57.721702 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e986fee2-e7a5-45e9-8c5e-125bcb8fbf96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:57.722320 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e986fee2-e7a5-45e9-8c5e-125bcb8fbf96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:57.728349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e986fee2-e7a5-45e9-8c5e-125bcb8fbf96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:57.728796 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e986fee2-e7a5-45e9-8c5e-125bcb8fbf96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:57.729560 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e986fee2-e7a5-45e9-8c5e-125bcb8fbf96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:57.729995 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e986fee2-e7a5-45e9-8c5e-125bcb8fbf96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:57.853557 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e986fee2-e7a5-45e9-8c5e-125bcb8fbf96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:57.861932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e986fee2-e7a5-45e9-8c5e-125bcb8fbf96 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.144655 Jul 01 07:09:57.862491 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 130/249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:57 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:58.104619 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e09c9260-92a2-493f-96a8-9c0a3940b600 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:58.105291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e09c9260-92a2-493f-96a8-9c0a3940b600 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:58.111790 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e09c9260-92a2-493f-96a8-9c0a3940b600 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:58.112238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e09c9260-92a2-493f-96a8-9c0a3940b600 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:58.112990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e09c9260-92a2-493f-96a8-9c0a3940b600 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:58.113424 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e09c9260-92a2-493f-96a8-9c0a3940b600 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:58.117353 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:09:58.243366 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e09c9260-92a2-493f-96a8-9c0a3940b600 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:58.251124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e09c9260-92a2-493f-96a8-9c0a3940b600 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.150270 Jul 01 07:09:58.251722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 120/250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:58 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:58.879527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6f371ba2-5706-4c58-869e-56801b7d4c11 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:58.880161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6f371ba2-5706-4c58-869e-56801b7d4c11 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:58.886103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6f371ba2-5706-4c58-869e-56801b7d4c11 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:58.886547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6f371ba2-5706-4c58-869e-56801b7d4c11 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:58.887341 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6f371ba2-5706-4c58-869e-56801b7d4c11 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:58.887774 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6f371ba2-5706-4c58-869e-56801b7d4c11 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:59.014894 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6f371ba2-5706-4c58-869e-56801b7d4c11 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:59.022762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6f371ba2-5706-4c58-869e-56801b7d4c11 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.147725 Jul 01 07:09:59.023346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 131/251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:58 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:09:59.267880 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2a6492c3-8d8d-42de-acae-70998b207e79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:09:59.268486 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2a6492c3-8d8d-42de-acae-70998b207e79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:09:59.274974 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a6492c3-8d8d-42de-acae-70998b207e79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:59.275424 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a6492c3-8d8d-42de-acae-70998b207e79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:59.276181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a6492c3-8d8d-42de-acae-70998b207e79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:09:59.276610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a6492c3-8d8d-42de-acae-70998b207e79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:09:59.404638 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2a6492c3-8d8d-42de-acae-70998b207e79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:09:59.412639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2a6492c3-8d8d-42de-acae-70998b207e79 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.148634 Jul 01 07:09:59.413190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 121/252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:09:59 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:00.040067 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-28dc2a80-86ca-4d67-bfa1-9a48b8b288f7 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:00.040673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-28dc2a80-86ca-4d67-bfa1-9a48b8b288f7 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:00.049391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-28dc2a80-86ca-4d67-bfa1-9a48b8b288f7 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:00.049891 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-28dc2a80-86ca-4d67-bfa1-9a48b8b288f7 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:00.050679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-28dc2a80-86ca-4d67-bfa1-9a48b8b288f7 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:00.051142 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-28dc2a80-86ca-4d67-bfa1-9a48b8b288f7 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:00.177816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-28dc2a80-86ca-4d67-bfa1-9a48b8b288f7 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:00.186071 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-28dc2a80-86ca-4d67-bfa1-9a48b8b288f7 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.149876 Jul 01 07:10:00.186641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 132/253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:00 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:00.429249 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-92f967d0-ddc0-4737-a1f9-a1e2473f78dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:00.429856 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-92f967d0-ddc0-4737-a1f9-a1e2473f78dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:00.436816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-92f967d0-ddc0-4737-a1f9-a1e2473f78dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:00.437275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-92f967d0-ddc0-4737-a1f9-a1e2473f78dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:00.438050 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-92f967d0-ddc0-4737-a1f9-a1e2473f78dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:00.438546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-92f967d0-ddc0-4737-a1f9-a1e2473f78dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:00.566230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-92f967d0-ddc0-4737-a1f9-a1e2473f78dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:00.573735 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-92f967d0-ddc0-4737-a1f9-a1e2473f78dd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.148248 Jul 01 07:10:00.574318 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 122/254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:00 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:01.202243 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9938286c-7c8d-4325-9a86-0782fcdf7368 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:01.203389 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9938286c-7c8d-4325-9a86-0782fcdf7368 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:01.209459 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9938286c-7c8d-4325-9a86-0782fcdf7368 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:01.209906 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9938286c-7c8d-4325-9a86-0782fcdf7368 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:01.211080 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9938286c-7c8d-4325-9a86-0782fcdf7368 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:01.211162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9938286c-7c8d-4325-9a86-0782fcdf7368 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:01.339529 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9938286c-7c8d-4325-9a86-0782fcdf7368 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:01.348460 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9938286c-7c8d-4325-9a86-0782fcdf7368 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.149887 Jul 01 07:10:01.349071 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 133/255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:01 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:01.590581 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6892117d-0376-44c3-9326-052656991329 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:01.591229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6892117d-0376-44c3-9326-052656991329 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:01.597225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6892117d-0376-44c3-9326-052656991329 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:01.598026 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6892117d-0376-44c3-9326-052656991329 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:01.598789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6892117d-0376-44c3-9326-052656991329 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:01.599242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6892117d-0376-44c3-9326-052656991329 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:01.722034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6892117d-0376-44c3-9326-052656991329 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:01.729429 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6892117d-0376-44c3-9326-052656991329 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.142788 Jul 01 07:10:01.729999 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 123/256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:01 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:02.366076 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e1c25e76-1efc-4bbb-9a4a-5c91d674df9f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:02.366696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e1c25e76-1efc-4bbb-9a4a-5c91d674df9f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:02.372967 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1c25e76-1efc-4bbb-9a4a-5c91d674df9f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:02.373457 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1c25e76-1efc-4bbb-9a4a-5c91d674df9f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:02.374214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1c25e76-1efc-4bbb-9a4a-5c91d674df9f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:02.374648 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1c25e76-1efc-4bbb-9a4a-5c91d674df9f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:02.502636 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e1c25e76-1efc-4bbb-9a4a-5c91d674df9f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:02.510708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e1c25e76-1efc-4bbb-9a4a-5c91d674df9f tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.148499 Jul 01 07:10:02.511299 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 134/257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:02 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:02.746857 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-818c18f4-2a79-4fa1-ab30-dc224c233f1a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:02.748141 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-818c18f4-2a79-4fa1-ab30-dc224c233f1a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:02.754245 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-818c18f4-2a79-4fa1-ab30-dc224c233f1a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:02.754689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-818c18f4-2a79-4fa1-ab30-dc224c233f1a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:02.755469 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-818c18f4-2a79-4fa1-ab30-dc224c233f1a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:02.755895 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-818c18f4-2a79-4fa1-ab30-dc224c233f1a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:02.884498 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-818c18f4-2a79-4fa1-ab30-dc224c233f1a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:02.891924 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-818c18f4-2a79-4fa1-ab30-dc224c233f1a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.149138 Jul 01 07:10:02.892484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 124/258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:02 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:03.527546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-33fe2838-8e58-4e78-8f69-4c566a7890fd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:03.528177 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-33fe2838-8e58-4e78-8f69-4c566a7890fd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:03.534370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-33fe2838-8e58-4e78-8f69-4c566a7890fd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:03.534842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-33fe2838-8e58-4e78-8f69-4c566a7890fd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:03.535603 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-33fe2838-8e58-4e78-8f69-4c566a7890fd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:03.536034 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-33fe2838-8e58-4e78-8f69-4c566a7890fd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:03.665090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-33fe2838-8e58-4e78-8f69-4c566a7890fd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:03.673834 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-33fe2838-8e58-4e78-8f69-4c566a7890fd tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1553 microversion: 2.1 time: 0.150100 Jul 01 07:10:03.675132 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 135/259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:03 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:03.909551 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bc50c20d-8f76-4654-8e37-9dfc1833297b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:03.910332 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bc50c20d-8f76-4654-8e37-9dfc1833297b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:03.917084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc50c20d-8f76-4654-8e37-9dfc1833297b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:03.917539 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc50c20d-8f76-4654-8e37-9dfc1833297b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:03.918496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc50c20d-8f76-4654-8e37-9dfc1833297b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:03.918928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc50c20d-8f76-4654-8e37-9dfc1833297b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:04.189521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bc50c20d-8f76-4654-8e37-9dfc1833297b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:04.197316 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bc50c20d-8f76-4654-8e37-9dfc1833297b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.292316 Jul 01 07:10:04.197890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 125/260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:03 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:04.706384 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-45e95a07-8192-48e7-ab06-3eafe9b6200d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:04.707925 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-45e95a07-8192-48e7-ab06-3eafe9b6200d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:04.727191 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45e95a07-8192-48e7-ab06-3eafe9b6200d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:04.727856 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45e95a07-8192-48e7-ab06-3eafe9b6200d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:04.734815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45e95a07-8192-48e7-ab06-3eafe9b6200d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:04.736229 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45e95a07-8192-48e7-ab06-3eafe9b6200d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:04.893644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-45e95a07-8192-48e7-ab06-3eafe9b6200d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:04.907615 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-45e95a07-8192-48e7-ab06-3eafe9b6200d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1511 microversion: 2.1 time: 0.213918 Jul 01 07:10:04.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 136/261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:04 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:04.920294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-99742e31-d94b-4af6-a5d4-8ba46828eb06 req-4ba7551f-1c03-4bc8-8921-4167fce4f609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc68164-9c81-4c8c-92a9-7845381bbff8", "name": "network-vif-deleted", "tag": "8e8b676a-7f20-4a8f-bf53-71349dc3312b"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:04.931526 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-99742e31-d94b-4af6-a5d4-8ba46828eb06 req-4ba7551f-1c03-4bc8-8921-4167fce4f609 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:04.932227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-99742e31-d94b-4af6-a5d4-8ba46828eb06 req-4ba7551f-1c03-4bc8-8921-4167fce4f609 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:04.946560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-99742e31-d94b-4af6-a5d4-8ba46828eb06 req-4ba7551f-1c03-4bc8-8921-4167fce4f609 service nova] Creating event network-vif-deleted:8e8b676a-7f20-4a8f-bf53-71349dc3312b for instance afc68164-9c81-4c8c-92a9-7845381bbff8 on hv-cinder-80721 Jul 01 07:10:04.952527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-99742e31-d94b-4af6-a5d4-8ba46828eb06 req-4ba7551f-1c03-4bc8-8921-4167fce4f609 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035580 Jul 01 07:10:04.953658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 126/262] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:10:05.217137 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0d578e43-3fba-46ff-9d53-b8b7cdbbb3ba tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:05.217752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0d578e43-3fba-46ff-9d53-b8b7cdbbb3ba tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:05.224691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0d578e43-3fba-46ff-9d53-b8b7cdbbb3ba tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:05.225144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0d578e43-3fba-46ff-9d53-b8b7cdbbb3ba tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:05.225898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0d578e43-3fba-46ff-9d53-b8b7cdbbb3ba tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:05.226511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0d578e43-3fba-46ff-9d53-b8b7cdbbb3ba tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:05.355045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0d578e43-3fba-46ff-9d53-b8b7cdbbb3ba tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:05.362990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0d578e43-3fba-46ff-9d53-b8b7cdbbb3ba tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.151898 Jul 01 07:10:05.363553 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 137/263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:05 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:05.925642 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-777adb8b-0320-4446-9725-a517ff8550a1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:05.926324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-777adb8b-0320-4446-9725-a517ff8550a1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:05.932816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-777adb8b-0320-4446-9725-a517ff8550a1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:05.933254 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-777adb8b-0320-4446-9725-a517ff8550a1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:05.934004 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-777adb8b-0320-4446-9725-a517ff8550a1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:05.934689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-777adb8b-0320-4446-9725-a517ff8550a1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:05.994591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-777adb8b-0320-4446-9725-a517ff8550a1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:06.003020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-777adb8b-0320-4446-9725-a517ff8550a1 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1346 microversion: 2.1 time: 0.081484 Jul 01 07:10:06.003588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 127/264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:05 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:06.380105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e7126bbc-0f8b-4e93-90a9-50fc4ef69326 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:06.380706 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e7126bbc-0f8b-4e93-90a9-50fc4ef69326 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:06.386670 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e7126bbc-0f8b-4e93-90a9-50fc4ef69326 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:06.387143 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e7126bbc-0f8b-4e93-90a9-50fc4ef69326 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:06.387893 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e7126bbc-0f8b-4e93-90a9-50fc4ef69326 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:06.388319 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e7126bbc-0f8b-4e93-90a9-50fc4ef69326 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:06.515627 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e7126bbc-0f8b-4e93-90a9-50fc4ef69326 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:06.522879 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e7126bbc-0f8b-4e93-90a9-50fc4ef69326 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.146526 Jul 01 07:10:06.523436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 138/265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:06 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:07.020539 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-66086c8c-822b-43c4-af46-a136547397a8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:07.021153 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-66086c8c-822b-43c4-af46-a136547397a8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:07.027580 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-66086c8c-822b-43c4-af46-a136547397a8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:07.028028 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-66086c8c-822b-43c4-af46-a136547397a8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:07.028785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-66086c8c-822b-43c4-af46-a136547397a8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:07.029221 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-66086c8c-822b-43c4-af46-a136547397a8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:07.094100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-66086c8c-822b-43c4-af46-a136547397a8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:07.104558 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-66086c8c-822b-43c4-af46-a136547397a8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1346 microversion: 2.1 time: 0.087839 Jul 01 07:10:07.105286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 128/266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:07 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:07.539820 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aed00239-a007-4bd5-a9cd-71b0e89f1a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:07.540355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-aed00239-a007-4bd5-a9cd-71b0e89f1a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:07.547188 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aed00239-a007-4bd5-a9cd-71b0e89f1a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:07.547641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aed00239-a007-4bd5-a9cd-71b0e89f1a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:07.548400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aed00239-a007-4bd5-a9cd-71b0e89f1a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:07.548832 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aed00239-a007-4bd5-a9cd-71b0e89f1a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:07.672790 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aed00239-a007-4bd5-a9cd-71b0e89f1a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:07.680224 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-aed00239-a007-4bd5-a9cd-71b0e89f1a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.144349 Jul 01 07:10:07.680809 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 139/267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:07 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:08.121772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-13b90fc8-84e6-4c15-9d7f-c1c79ff673d8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:08.122385 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-13b90fc8-84e6-4c15-9d7f-c1c79ff673d8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:08.129414 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-13b90fc8-84e6-4c15-9d7f-c1c79ff673d8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:08.129869 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-13b90fc8-84e6-4c15-9d7f-c1c79ff673d8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:08.130631 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-13b90fc8-84e6-4c15-9d7f-c1c79ff673d8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:08.131101 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-13b90fc8-84e6-4c15-9d7f-c1c79ff673d8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:08.195485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-13b90fc8-84e6-4c15-9d7f-c1c79ff673d8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:08.204055 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-13b90fc8-84e6-4c15-9d7f-c1c79ff673d8 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1346 microversion: 2.1 time: 0.086103 Jul 01 07:10:08.204620 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 129/268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:08 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:08.697339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9552a0f0-0111-4071-956d-094ad456fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:08.697977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9552a0f0-0111-4071-956d-094ad456fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:08.704052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9552a0f0-0111-4071-956d-094ad456fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:08.704504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9552a0f0-0111-4071-956d-094ad456fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:08.705267 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9552a0f0-0111-4071-956d-094ad456fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:08.705702 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9552a0f0-0111-4071-956d-094ad456fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:08.829727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9552a0f0-0111-4071-956d-094ad456fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:08.837177 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9552a0f0-0111-4071-956d-094ad456fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.143667 Jul 01 07:10:08.837737 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 140/269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:08 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:09.220170 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0755cf07-cb0d-4f9e-b94c-da7bdb92944a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:09.220777 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0755cf07-cb0d-4f9e-b94c-da7bdb92944a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:09.227200 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0755cf07-cb0d-4f9e-b94c-da7bdb92944a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:09.227650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0755cf07-cb0d-4f9e-b94c-da7bdb92944a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:09.228405 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0755cf07-cb0d-4f9e-b94c-da7bdb92944a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:09.228840 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0755cf07-cb0d-4f9e-b94c-da7bdb92944a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:09.288580 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0755cf07-cb0d-4f9e-b94c-da7bdb92944a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:09.296979 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0755cf07-cb0d-4f9e-b94c-da7bdb92944a tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1346 microversion: 2.1 time: 0.080241 Jul 01 07:10:09.297575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 130/270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:09 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:09.853846 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b7f8c0b4-7757-4c69-9743-b73cb3b9566d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:09.854463 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b7f8c0b4-7757-4c69-9743-b73cb3b9566d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:09.861077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7f8c0b4-7757-4c69-9743-b73cb3b9566d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:09.861523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7f8c0b4-7757-4c69-9743-b73cb3b9566d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:09.862274 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7f8c0b4-7757-4c69-9743-b73cb3b9566d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:09.862705 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7f8c0b4-7757-4c69-9743-b73cb3b9566d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:09.988888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b7f8c0b4-7757-4c69-9743-b73cb3b9566d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:09.996342 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b7f8c0b4-7757-4c69-9743-b73cb3b9566d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.146296 Jul 01 07:10:09.996903 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 141/271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:09 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:10.313810 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f75cb27e-585f-4ac1-a676-3835cb252c82 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:10.314450 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f75cb27e-585f-4ac1-a676-3835cb252c82 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:10.320850 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f75cb27e-585f-4ac1-a676-3835cb252c82 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:10.321302 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f75cb27e-585f-4ac1-a676-3835cb252c82 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:10.322059 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f75cb27e-585f-4ac1-a676-3835cb252c82 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:10.322495 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f75cb27e-585f-4ac1-a676-3835cb252c82 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:10.382492 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f75cb27e-585f-4ac1-a676-3835cb252c82 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:10.390977 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f75cb27e-585f-4ac1-a676-3835cb252c82 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1346 microversion: 2.1 time: 0.081114 Jul 01 07:10:10.391538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 131/272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:10 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:11.013090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-66a79672-156d-4b8c-9ef8-c596509677af tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:11.013780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-66a79672-156d-4b8c-9ef8-c596509677af tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:11.019879 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66a79672-156d-4b8c-9ef8-c596509677af tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:11.020373 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66a79672-156d-4b8c-9ef8-c596509677af tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:11.021124 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66a79672-156d-4b8c-9ef8-c596509677af tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:11.021595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66a79672-156d-4b8c-9ef8-c596509677af tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:11.163822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-66a79672-156d-4b8c-9ef8-c596509677af tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:11.171196 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-66a79672-156d-4b8c-9ef8-c596509677af tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.161962 Jul 01 07:10:11.172362 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 142/273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:11 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:11.407930 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d4e16bcb-0dc9-4299-8ef5-26526de506f5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:11.408537 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d4e16bcb-0dc9-4299-8ef5-26526de506f5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:11.415076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4e16bcb-0dc9-4299-8ef5-26526de506f5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:11.415542 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4e16bcb-0dc9-4299-8ef5-26526de506f5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:11.416292 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4e16bcb-0dc9-4299-8ef5-26526de506f5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:11.416726 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4e16bcb-0dc9-4299-8ef5-26526de506f5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:11.486274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d4e16bcb-0dc9-4299-8ef5-26526de506f5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec800c1fb0e74f2caabab848db0432db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa10fec302f0464ead56582b81409441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:11.494881 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d4e16bcb-0dc9-4299-8ef5-26526de506f5 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 200 len: 1346 microversion: 2.1 time: 0.091274 Jul 01 07:10:11.495441 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 132/274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:11 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:12.188675 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e8024432-cc98-46ea-b6ae-0c8f85e887c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:12.189402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e8024432-cc98-46ea-b6ae-0c8f85e887c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:12.195453 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8024432-cc98-46ea-b6ae-0c8f85e887c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:12.195901 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8024432-cc98-46ea-b6ae-0c8f85e887c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:12.196667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8024432-cc98-46ea-b6ae-0c8f85e887c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:12.197101 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8024432-cc98-46ea-b6ae-0c8f85e887c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:12.329134 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e8024432-cc98-46ea-b6ae-0c8f85e887c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:12.337538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e8024432-cc98-46ea-b6ae-0c8f85e887c5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.152840 Jul 01 07:10:12.338226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 143/275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:12 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:12.512641 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:12.513460 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:12.520880 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:12.521759 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:12.522666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:12.523158 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:12.538890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] HTTP exception thrown: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Request method failure captured: Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 HTTP/1.1 Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1rWpbmE60r3Kw5L2yVdJ4NtTjYS8xTt4PwpcehqwZahGO2eu8303golg7cBqEDdEhSaNtr679d0sZMEAJb4fjs5YSLB4KGkp7MBCptx3jk_2p13JkgQXP90S9vXIdr0gZxpm4g5u4wYDJbs4q-Yot0JZBv8eNwuU6yhSHlXzlmZBU Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: fa10fec302f0464ead56582b81409441 Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:10:12.543781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa10fec302f0464ead56582b81409441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa10fec302f0464ead56582b81409441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa10fec302f0464ead56582b81409441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa10fec302f0464ead56582b81409441"}]}] Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: fa10fec302f0464ead56582b81409441 Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-DeleteServersTestJSON-1688320683-project Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: ec800c1fb0e74f2caabab848db0432db Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-DeleteServersTestJSON-1688320683-project Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.545345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': 'afc68164-9c81-4c8c-92a9-7845381bbff8'} Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:10:12.549485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.551177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.552430 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Returning 404 to user: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:10:12.552430 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-77e6edc6-b99f-484c-a4f1-dba4c0bc3c13 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 404 len: 111 microversion: 2.1 time: 0.036923 Jul 01 07:10:12.552430 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 133/276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:12 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:10:12.664529 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:12.665725 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:12.673137 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:12.673587 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:12.674883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:12.675830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:12.691685 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] HTTP exception thrown: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Request method failure captured: Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8/os-volume_attachments HTTP/1.1 Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1rWpbmE60r3Kw5L2yVdJ4NtTjYS8xTt4PwpcehqwZahGO2eu8303golg7cBqEDdEhSaNtr679d0sZMEAJb4fjs5YSLB4KGkp7MBCptx3jk_2p13JkgQXP90S9vXIdr0gZxpm4g5u4wYDJbs4q-Yot0JZBv8eNwuU6yhSHlXzlmZBU Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: fa10fec302f0464ead56582b81409441 Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:10:12.701422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa10fec302f0464ead56582b81409441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa10fec302f0464ead56582b81409441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa10fec302f0464ead56582b81409441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa10fec302f0464ead56582b81409441"}]}] Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: fa10fec302f0464ead56582b81409441 Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-DeleteServersTestJSON-1688320683-project Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: ec800c1fb0e74f2caabab848db0432db Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-DeleteServersTestJSON-1688320683-project Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.703613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'server_id': 'afc68164-9c81-4c8c-92a9-7845381bbff8'} Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:10:12.704422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:12.705643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:12.707441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Returning 404 to user: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:10:12.707441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3854403b-eb8b-4f08-891b-dff6f7bd740b tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043656 Jul 01 07:10:12.707441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 144/277] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:10:12 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 07:10:13.355717 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0dd2b379-e08f-4ab9-b28f-7f404abdb8a8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:13.356326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0dd2b379-e08f-4ab9-b28f-7f404abdb8a8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:13.362386 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0dd2b379-e08f-4ab9-b28f-7f404abdb8a8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:13.362866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0dd2b379-e08f-4ab9-b28f-7f404abdb8a8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:13.363671 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0dd2b379-e08f-4ab9-b28f-7f404abdb8a8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:13.364313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0dd2b379-e08f-4ab9-b28f-7f404abdb8a8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:13.510861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0dd2b379-e08f-4ab9-b28f-7f404abdb8a8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:13.529854 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0dd2b379-e08f-4ab9-b28f-7f404abdb8a8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.170698 Jul 01 07:10:13.532523 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 134/278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:13 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:10:14.550348 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a198c280-d60c-4d22-bc2a-7cc653b0a7a9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:14.551100 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a198c280-d60c-4d22-bc2a-7cc653b0a7a9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:14.563160 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a198c280-d60c-4d22-bc2a-7cc653b0a7a9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:14.563612 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a198c280-d60c-4d22-bc2a-7cc653b0a7a9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:14.564403 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a198c280-d60c-4d22-bc2a-7cc653b0a7a9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:14.564838 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a198c280-d60c-4d22-bc2a-7cc653b0a7a9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:14.569189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:14.713188 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a198c280-d60c-4d22-bc2a-7cc653b0a7a9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:14.721388 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a198c280-d60c-4d22-bc2a-7cc653b0a7a9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.176223 Jul 01 07:10:14.722020 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 145/279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:14 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:15.099420 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:15.099914 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:15.106518 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:15.107087 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:15.108187 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:15.109503 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:15.125527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] HTTP exception thrown: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Request method failure captured: Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: DELETE /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 HTTP/1.1 Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1rWpbmE60r3Kw5L2yVdJ4NtTjYS8xTt4PwpcehqwZahGO2eu8303golg7cBqEDdEhSaNtr679d0sZMEAJb4fjs5YSLB4KGkp7MBCptx3jk_2p13JkgQXP90S9vXIdr0gZxpm4g5u4wYDJbs4q-Yot0JZBv8eNwuU6yhSHlXzlmZBU Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: fa10fec302f0464ead56582b81409441 Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:10:15.128731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa10fec302f0464ead56582b81409441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa10fec302f0464ead56582b81409441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa10fec302f0464ead56582b81409441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa10fec302f0464ead56582b81409441"}]}] Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: fa10fec302f0464ead56582b81409441 Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-DeleteServersTestJSON-1688320683-project Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: ec800c1fb0e74f2caabab848db0432db Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-DeleteServersTestJSON-1688320683-project Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.130202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': 'afc68164-9c81-4c8c-92a9-7845381bbff8'} Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:10:15.130921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.133279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.136274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Returning 404 to user: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:10:15.136274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-abefea7e-1fba-4a35-82f1-83d045a68320 tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "DELETE /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 404 len: 111 microversion: 2.1 time: 0.034698 Jul 01 07:10:15.136274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 135/280] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:10:15 2022] DELETE /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:10:15.145286 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:15.146147 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] [instance: afc68164-9c81-4c8c-92a9-7845381bbff8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:15.157764 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:15.158878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:15.161589 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:15.162244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:15.182208 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] HTTP exception thrown: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Request method failure captured: Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 HTTP/1.1 Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1rWpbmE60r3Kw5L2yVdJ4NtTjYS8xTt4PwpcehqwZahGO2eu8303golg7cBqEDdEhSaNtr679d0sZMEAJb4fjs5YSLB4KGkp7MBCptx3jk_2p13JkgQXP90S9vXIdr0gZxpm4g5u4wYDJbs4q-Yot0JZBv8eNwuU6yhSHlXzlmZBU Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: fa10fec302f0464ead56582b81409441 Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:10:15.184945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa10fec302f0464ead56582b81409441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa10fec302f0464ead56582b81409441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa10fec302f0464ead56582b81409441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa10fec302f0464ead56582b81409441"}]}] Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: fa10fec302f0464ead56582b81409441 Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-DeleteServersTestJSON-1688320683 Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-DeleteServersTestJSON-1688320683-project Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: ec800c1fb0e74f2caabab848db0432db Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-DeleteServersTestJSON-1688320683-project Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.186401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': 'afc68164-9c81-4c8c-92a9-7845381bbff8'} Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:10:15.187752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. Jul 01 07:10:15.197665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:15.200123 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] Returning 404 to user: Instance afc68164-9c81-4c8c-92a9-7845381bbff8 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:10:15.200123 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0a0c7943-9ba3-424d-8f11-4cba9b3ebd7d tempest-DeleteServersTestJSON-1688320683 tempest-DeleteServersTestJSON-1688320683-project] 10.222.0.48 "GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8" status: 404 len: 111 microversion: 2.1 time: 0.050377 Jul 01 07:10:15.200123 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 146/281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:15 2022] GET /compute/v2.1/servers/afc68164-9c81-4c8c-92a9-7845381bbff8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:10:15.744842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9f3949f2-edf7-4918-b134-89ff59bc64c8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:15.745688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9f3949f2-edf7-4918-b134-89ff59bc64c8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:15.753365 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9f3949f2-edf7-4918-b134-89ff59bc64c8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:15.754177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9f3949f2-edf7-4918-b134-89ff59bc64c8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:15.755207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9f3949f2-edf7-4918-b134-89ff59bc64c8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:15.755873 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9f3949f2-edf7-4918-b134-89ff59bc64c8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:15.985748 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9f3949f2-edf7-4918-b134-89ff59bc64c8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:15.995588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9f3949f2-edf7-4918-b134-89ff59bc64c8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.255539 Jul 01 07:10:15.999866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 136/282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:15 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:17.013477 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-256104a9-f7b3-445d-a661-a528cd3b39be tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:17.014763 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-256104a9-f7b3-445d-a661-a528cd3b39be tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:17.021830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-256104a9-f7b3-445d-a661-a528cd3b39be tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:17.026867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-256104a9-f7b3-445d-a661-a528cd3b39be tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:17.028178 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-256104a9-f7b3-445d-a661-a528cd3b39be tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:17.031075 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-256104a9-f7b3-445d-a661-a528cd3b39be tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:17.582914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-256104a9-f7b3-445d-a661-a528cd3b39be tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:17.593602 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-256104a9-f7b3-445d-a661-a528cd3b39be tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.584339 Jul 01 07:10:17.595263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 147/283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:17 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:18.610711 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-26d29c7b-2509-4b05-b4ee-0d8d400e34aa tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:18.611300 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-26d29c7b-2509-4b05-b4ee-0d8d400e34aa tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:18.617944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-26d29c7b-2509-4b05-b4ee-0d8d400e34aa tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:18.618398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-26d29c7b-2509-4b05-b4ee-0d8d400e34aa tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:18.619267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-26d29c7b-2509-4b05-b4ee-0d8d400e34aa tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:18.620179 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-26d29c7b-2509-4b05-b4ee-0d8d400e34aa tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:18.783181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-26d29c7b-2509-4b05-b4ee-0d8d400e34aa tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:18.793917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-26d29c7b-2509-4b05-b4ee-0d8d400e34aa tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.185637 Jul 01 07:10:18.793917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 137/284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:18 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:19.809613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-040bae81-5442-46b3-9a5d-4d1d1cba0b8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:19.810221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-040bae81-5442-46b3-9a5d-4d1d1cba0b8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:19.812194 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=52 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:19.817566 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-040bae81-5442-46b3-9a5d-4d1d1cba0b8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:19.818014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-040bae81-5442-46b3-9a5d-4d1d1cba0b8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:19.819039 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-040bae81-5442-46b3-9a5d-4d1d1cba0b8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:19.819317 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-040bae81-5442-46b3-9a5d-4d1d1cba0b8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:19.964572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-040bae81-5442-46b3-9a5d-4d1d1cba0b8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:19.972875 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-040bae81-5442-46b3-9a5d-4d1d1cba0b8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.167328 Jul 01 07:10:19.973434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 148/285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:19 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:20.990333 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2537c5d4-d62e-4848-b5fc-042d4168d43a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:20.990983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2537c5d4-d62e-4848-b5fc-042d4168d43a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:20.997905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2537c5d4-d62e-4848-b5fc-042d4168d43a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:20.998366 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2537c5d4-d62e-4848-b5fc-042d4168d43a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:20.999188 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2537c5d4-d62e-4848-b5fc-042d4168d43a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:20.999749 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2537c5d4-d62e-4848-b5fc-042d4168d43a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:21.229937 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2537c5d4-d62e-4848-b5fc-042d4168d43a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:21.234066 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:21.242148 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2537c5d4-d62e-4848-b5fc-042d4168d43a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.256074 Jul 01 07:10:21.253327 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 138/286] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:20 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:22.260716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5d8bc1a6-e2c9-4e13-a4fc-67399ccb7c7c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:22.261344 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5d8bc1a6-e2c9-4e13-a4fc-67399ccb7c7c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:22.267853 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d8bc1a6-e2c9-4e13-a4fc-67399ccb7c7c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:22.268309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d8bc1a6-e2c9-4e13-a4fc-67399ccb7c7c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:22.269081 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d8bc1a6-e2c9-4e13-a4fc-67399ccb7c7c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:22.269927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d8bc1a6-e2c9-4e13-a4fc-67399ccb7c7c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:22.509906 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5d8bc1a6-e2c9-4e13-a4fc-67399ccb7c7c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:22.520695 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5d8bc1a6-e2c9-4e13-a4fc-67399ccb7c7c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1522 microversion: 2.1 time: 0.262921 Jul 01 07:10:22.535339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 149/287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:22 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:23.541575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fbe0976e-7186-49bf-9fbf-15b42cea4473 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:23.542133 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fbe0976e-7186-49bf-9fbf-15b42cea4473 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:23.549132 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbe0976e-7186-49bf-9fbf-15b42cea4473 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:23.549587 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbe0976e-7186-49bf-9fbf-15b42cea4473 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:23.550352 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbe0976e-7186-49bf-9fbf-15b42cea4473 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:23.550812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbe0976e-7186-49bf-9fbf-15b42cea4473 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:23.789286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fbe0976e-7186-49bf-9fbf-15b42cea4473 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:23.797538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fbe0976e-7186-49bf-9fbf-15b42cea4473 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1502 microversion: 2.1 time: 0.259882 Jul 01 07:10:23.798112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 139/288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:23 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:23.826129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1ff43862-44bd-4ec8-bc3e-8249e2b342c3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:23.826129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1ff43862-44bd-4ec8-bc3e-8249e2b342c3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:23.831474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1ff43862-44bd-4ec8-bc3e-8249e2b342c3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:23.831924 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1ff43862-44bd-4ec8-bc3e-8249e2b342c3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:23.832695 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1ff43862-44bd-4ec8-bc3e-8249e2b342c3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:23.833127 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1ff43862-44bd-4ec8-bc3e-8249e2b342c3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:23.962661 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1ff43862-44bd-4ec8-bc3e-8249e2b342c3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:23.970047 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1ff43862-44bd-4ec8-bc3e-8249e2b342c3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1516 microversion: 2.1 time: 0.156172 Jul 01 07:10:23.970595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 150/289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:23 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:29.547544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8122b69f-521f-4f5f-ade1-a1e70a1a3c4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:29.548481 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8122b69f-521f-4f5f-ade1-a1e70a1a3c4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:29.550918 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=46 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:29.556467 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8122b69f-521f-4f5f-ade1-a1e70a1a3c4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:29.556992 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8122b69f-521f-4f5f-ade1-a1e70a1a3c4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:29.557755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8122b69f-521f-4f5f-ade1-a1e70a1a3c4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:29.558190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8122b69f-521f-4f5f-ade1-a1e70a1a3c4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:29.582220 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-8122b69f-521f-4f5f-ade1-a1e70a1a3c4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lazy-loading 'flavor' on Instance uuid 3445a4a9-908c-4f8d-a9f0-192f84c2158a {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:10:29.690591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8122b69f-521f-4f5f-ade1-a1e70a1a3c4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a/action" status: 200 len: 32 microversion: 2.1 time: 0.147540 Jul 01 07:10:29.691319 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 140/290] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:10:29 2022] POST /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:10:29.700242 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0cf06e9e-1642-424d-bcb9-5c5df662eb82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:29.701662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0cf06e9e-1642-424d-bcb9-5c5df662eb82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:29.708488 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0cf06e9e-1642-424d-bcb9-5c5df662eb82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:29.708968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0cf06e9e-1642-424d-bcb9-5c5df662eb82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:29.709888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0cf06e9e-1642-424d-bcb9-5c5df662eb82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:29.710317 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0cf06e9e-1642-424d-bcb9-5c5df662eb82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:29.937239 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0cf06e9e-1642-424d-bcb9-5c5df662eb82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:29.946165 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0cf06e9e-1642-424d-bcb9-5c5df662eb82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.249608 Jul 01 07:10:29.946878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 151/291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:29 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:30.965295 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b576851c-0826-409b-bf7e-6fcbfd5dabe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:30.965957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b576851c-0826-409b-bf7e-6fcbfd5dabe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:30.974684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b576851c-0826-409b-bf7e-6fcbfd5dabe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:30.975162 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b576851c-0826-409b-bf7e-6fcbfd5dabe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:30.975929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b576851c-0826-409b-bf7e-6fcbfd5dabe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:30.976359 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b576851c-0826-409b-bf7e-6fcbfd5dabe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:31.123685 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b576851c-0826-409b-bf7e-6fcbfd5dabe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:31.131648 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b576851c-0826-409b-bf7e-6fcbfd5dabe3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.171752 Jul 01 07:10:31.132212 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 141/292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:30 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:32.150600 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5715ed6f-ea65-49bd-a2e3-d31ae3cae5fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:32.151990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5715ed6f-ea65-49bd-a2e3-d31ae3cae5fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:32.167588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5715ed6f-ea65-49bd-a2e3-d31ae3cae5fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:32.168380 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5715ed6f-ea65-49bd-a2e3-d31ae3cae5fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:32.169642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5715ed6f-ea65-49bd-a2e3-d31ae3cae5fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:32.170260 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5715ed6f-ea65-49bd-a2e3-d31ae3cae5fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:32.326384 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5715ed6f-ea65-49bd-a2e3-d31ae3cae5fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:32.335236 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5715ed6f-ea65-49bd-a2e3-d31ae3cae5fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.189129 Jul 01 07:10:32.345826 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 152/293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:32 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:33.352852 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-78857d47-f414-45c2-8cc6-a09341d579c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:33.354322 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-78857d47-f414-45c2-8cc6-a09341d579c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:33.360762 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-78857d47-f414-45c2-8cc6-a09341d579c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:33.361390 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-78857d47-f414-45c2-8cc6-a09341d579c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:33.362414 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-78857d47-f414-45c2-8cc6-a09341d579c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:33.362986 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-78857d47-f414-45c2-8cc6-a09341d579c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:33.664462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-78857d47-f414-45c2-8cc6-a09341d579c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:33.677614 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-78857d47-f414-45c2-8cc6-a09341d579c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.328274 Jul 01 07:10:33.688923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 142/294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:33 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:34.695531 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-68c2c0cf-5a72-4f09-8ead-7e65da0c7872 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:34.696741 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-68c2c0cf-5a72-4f09-8ead-7e65da0c7872 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:34.702960 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-68c2c0cf-5a72-4f09-8ead-7e65da0c7872 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:34.703447 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-68c2c0cf-5a72-4f09-8ead-7e65da0c7872 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:34.704216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-68c2c0cf-5a72-4f09-8ead-7e65da0c7872 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:34.704643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-68c2c0cf-5a72-4f09-8ead-7e65da0c7872 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:34.894966 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-68c2c0cf-5a72-4f09-8ead-7e65da0c7872 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:34.902745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-68c2c0cf-5a72-4f09-8ead-7e65da0c7872 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.210955 Jul 01 07:10:34.903328 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 153/295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:34 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:35.920214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bcbde8d9-b5b4-417b-b272-e3e537be8814 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:35.920966 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bcbde8d9-b5b4-417b-b272-e3e537be8814 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:35.928355 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bcbde8d9-b5b4-417b-b272-e3e537be8814 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:35.928849 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bcbde8d9-b5b4-417b-b272-e3e537be8814 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:35.929627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bcbde8d9-b5b4-417b-b272-e3e537be8814 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:35.930066 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bcbde8d9-b5b4-417b-b272-e3e537be8814 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:36.136717 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bcbde8d9-b5b4-417b-b272-e3e537be8814 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:36.145391 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bcbde8d9-b5b4-417b-b272-e3e537be8814 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.229178 Jul 01 07:10:36.146054 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 143/296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:35 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:37.162614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f0fb6f81-a07b-4753-b201-fe46d3790194 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:37.163162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f0fb6f81-a07b-4753-b201-fe46d3790194 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:37.176483 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f0fb6f81-a07b-4753-b201-fe46d3790194 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:37.176935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f0fb6f81-a07b-4753-b201-fe46d3790194 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:37.177702 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f0fb6f81-a07b-4753-b201-fe46d3790194 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:37.178129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f0fb6f81-a07b-4753-b201-fe46d3790194 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:37.404236 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f0fb6f81-a07b-4753-b201-fe46d3790194 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:37.413473 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f0fb6f81-a07b-4753-b201-fe46d3790194 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.254619 Jul 01 07:10:37.414027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 154/297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:37 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:38.432889 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-76360a18-2fe1-4ead-93b0-369390bd6f77 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:38.435840 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-76360a18-2fe1-4ead-93b0-369390bd6f77 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:38.449632 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-76360a18-2fe1-4ead-93b0-369390bd6f77 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:38.450293 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-76360a18-2fe1-4ead-93b0-369390bd6f77 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:38.451262 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-76360a18-2fe1-4ead-93b0-369390bd6f77 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:38.451707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-76360a18-2fe1-4ead-93b0-369390bd6f77 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:39.106048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-76360a18-2fe1-4ead-93b0-369390bd6f77 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:39.116514 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-76360a18-2fe1-4ead-93b0-369390bd6f77 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.687883 Jul 01 07:10:39.118313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 144/298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:38 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:40.136277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-af15b479-1cc2-4318-898b-94b5f3caef02 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:40.136972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-af15b479-1cc2-4318-898b-94b5f3caef02 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:40.148055 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af15b479-1cc2-4318-898b-94b5f3caef02 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:40.148460 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af15b479-1cc2-4318-898b-94b5f3caef02 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:40.151043 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af15b479-1cc2-4318-898b-94b5f3caef02 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:40.151691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af15b479-1cc2-4318-898b-94b5f3caef02 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:40.728559 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-af15b479-1cc2-4318-898b-94b5f3caef02 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:40.737320 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-af15b479-1cc2-4318-898b-94b5f3caef02 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.605149 Jul 01 07:10:40.737883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 155/299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:40 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:41.757069 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f66458aa-70a5-464b-a2d5-1847f090ff47 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:41.757837 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f66458aa-70a5-464b-a2d5-1847f090ff47 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:41.766600 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f66458aa-70a5-464b-a2d5-1847f090ff47 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:41.767430 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f66458aa-70a5-464b-a2d5-1847f090ff47 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:41.768431 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f66458aa-70a5-464b-a2d5-1847f090ff47 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:41.769150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f66458aa-70a5-464b-a2d5-1847f090ff47 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:42.261946 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f66458aa-70a5-464b-a2d5-1847f090ff47 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:42.274812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f66458aa-70a5-464b-a2d5-1847f090ff47 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.519078 Jul 01 07:10:42.286610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 145/300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:41 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:43.295972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-09a82563-eb36-4c2b-b4f7-0f0f4c26a023 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:43.298729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-09a82563-eb36-4c2b-b4f7-0f0f4c26a023 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:43.315893 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-09a82563-eb36-4c2b-b4f7-0f0f4c26a023 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:43.316364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-09a82563-eb36-4c2b-b4f7-0f0f4c26a023 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:43.317186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-09a82563-eb36-4c2b-b4f7-0f0f4c26a023 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:43.322491 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-09a82563-eb36-4c2b-b4f7-0f0f4c26a023 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:43.605521 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-09a82563-eb36-4c2b-b4f7-0f0f4c26a023 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:43.614029 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-09a82563-eb36-4c2b-b4f7-0f0f4c26a023 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.324423 Jul 01 07:10:43.614868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 156/301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:43 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:44.441360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3278e8d5-c8a2-463b-bfb3-516bf9d55e1a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Action: 'create', calling method: .version_select at 0x7f2c4a638040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1681175753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZZUQJJUdBQosEUynFH7VowJO5+DsEMuwmnPq6fbGmx5S5ZYPJpY5w+SkTKs+UH67XMgpHjej6KNm9+AssmCpK2txY4h3Ideu5ww/emaygAwFWam+UNQJJt+iafOPpDMg=="}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:44.460097 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-3278e8d5-c8a2-463b-bfb3-516bf9d55e1a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Getting quotas for project d8def43018744d7b8d5a5f422e44bf89. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:10:44.465978 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-3278e8d5-c8a2-463b-bfb3-516bf9d55e1a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Getting quotas for user 0a36e02c916b494180e68d3f231ee714 and project d8def43018744d7b8d5a5f422e44bf89. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:10:44.490515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3278e8d5-c8a2-463b-bfb3-516bf9d55e1a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.248974 Jul 01 07:10:44.490972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 146/302] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:10:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:10:44.630999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fee55112-a450-4f0b-8808-c6c03194bc68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:44.632143 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fee55112-a450-4f0b-8808-c6c03194bc68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:44.638430 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fee55112-a450-4f0b-8808-c6c03194bc68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:44.639296 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fee55112-a450-4f0b-8808-c6c03194bc68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:44.640265 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fee55112-a450-4f0b-8808-c6c03194bc68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:44.641243 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fee55112-a450-4f0b-8808-c6c03194bc68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:44.645433 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=67 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:44.878478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fee55112-a450-4f0b-8808-c6c03194bc68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:44.887857 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fee55112-a450-4f0b-8808-c6c03194bc68 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.261036 Jul 01 07:10:44.888709 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 157/303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:44 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:45.440045 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1109665271", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "networks": [{"uuid": "276838b3-8831-458c-bc9c-231564b00696"}]}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:45.495530 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] validate_networks() for [('276838b3-8831-458c-bc9c-231564b00696', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:10:45.910238 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-96f815e8-1042-4d89-b8b3-497d783bcc8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:45.912893 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-96f815e8-1042-4d89-b8b3-497d783bcc8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:45.928732 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-96f815e8-1042-4d89-b8b3-497d783bcc8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:45.930498 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-96f815e8-1042-4d89-b8b3-497d783bcc8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:45.932722 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-96f815e8-1042-4d89-b8b3-497d783bcc8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:45.933574 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-96f815e8-1042-4d89-b8b3-497d783bcc8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:45.981337 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:10:45.981977 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:10:45.982702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:10:45.983577 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:10:45.984752 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:10:46.000936 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:46.002486 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:46.004606 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:46.005239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:46.029388 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Getting quotas for project 1c5b07c9b6004015bc1e693324d246ce. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:10:46.033692 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Getting quotas for user 6e8e19cb76464144a74a8504bcc42083 and project 1c5b07c9b6004015bc1e693324d246ce. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:10:46.045634 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:10:46.048706 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:10:46.113415 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6761a818-3835-49da-902f-911575928144 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678903 Jul 01 07:10:46.115532 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 147/304] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:10:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:10:46.139152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-96f815e8-1042-4d89-b8b3-497d783bcc8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:46.139728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a2ed2e77-3c73-4fa8-8dc3-580cb58b13fe tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:46.140901 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a2ed2e77-3c73-4fa8-8dc3-580cb58b13fe tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:46.155434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-96f815e8-1042-4d89-b8b3-497d783bcc8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1502 microversion: 2.1 time: 0.247887 Jul 01 07:10:46.169524 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 158/305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:45 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1502 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:46.183677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db8f8e14-9b0b-46e6-a094-7624215a731c"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:46.185390 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:46.201998 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:46.203892 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:46.204893 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:46.206453 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:46.209189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a2ed2e77-3c73-4fa8-8dc3-580cb58b13fe tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:46.217088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a2ed2e77-3c73-4fa8-8dc3-580cb58b13fe tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1214 microversion: 2.1 time: 0.090178 Jul 01 07:10:46.217962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 148/306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:46 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:46.241392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] HTTP exception thrown: Cannot 'attach_volume' instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a while it is in vm_state rescued Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Request method failure captured: Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: POST /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a/os-volume_attachments HTTP/1.1 Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 74 Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1vWP5A9U2vwZcgA-tmIL0Abtmkf8fLJBmpYavmK6tX87ap-wh-MMPjAN54eWsMEvlA9CNKK8ZNJvBN_sDBho2dlNvmRqfRkrjl7kZ9B5Xu8-dyRRMNjooE7_SwyP6EeN2-wfuby7sk0XY1GHr44Xqj8fuKtr5klSaTUVH2ziarw-8 Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:10:46.243014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d94c1c234804421487c49cc9df6ff888"}]}] Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 4549c33736bc413a87460db0c43f5768 Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {"volumeAttachment": {"volumeId": "db8f8e14-9b0b-46e6-a094-7624215a731c"}} Jul 01 07:10:46.244401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Cannot 'attach_volume' instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a while it is in vm_state rescued Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'server_id': '3445a4a9-908c-4f8d-a9f0-192f84c2158a', 'body': {'volumeAttachment': {'volumeId': 'db8f8e14-9b0b-46e6-a094-7624215a731c'}}} Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:10:46.245129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a while it is in vm_state rescued Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:10:46.249458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:10:46.251818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:10:46.251818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:10:46.251818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a while it is in vm_state rescued Jul 01 07:10:46.251818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:10:46.251818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Returning 409 to user: Cannot 'attach_volume' instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a while it is in vm_state rescued {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:10:46.251818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8b8aaf56-8741-45fb-be76-f4a50b69df07 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074101 Jul 01 07:10:46.251818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 159/307] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:10:46 2022] POST /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a/os-volume_attachments => generated 152 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 07:10:46.257862 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-670d9315-ae75-4b51-bb97-4d3563299b3a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:46.258680 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-670d9315-ae75-4b51-bb97-4d3563299b3a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:46.268009 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-670d9315-ae75-4b51-bb97-4d3563299b3a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:46.268839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-670d9315-ae75-4b51-bb97-4d3563299b3a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:46.269943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-670d9315-ae75-4b51-bb97-4d3563299b3a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:46.270604 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-670d9315-ae75-4b51-bb97-4d3563299b3a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:46.367954 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-670d9315-ae75-4b51-bb97-4d3563299b3a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a/action" status: 202 len: 0 microversion: 2.1 time: 0.115599 Jul 01 07:10:46.369027 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 149/308] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:10:46 2022] POST /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:10:46.378030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b7013542-2a2b-4ff9-a06a-e43d55e96c87 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:46.378879 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b7013542-2a2b-4ff9-a06a-e43d55e96c87 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:46.393135 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7013542-2a2b-4ff9-a06a-e43d55e96c87 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:46.393673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7013542-2a2b-4ff9-a06a-e43d55e96c87 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:46.394450 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7013542-2a2b-4ff9-a06a-e43d55e96c87 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:46.394917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b7013542-2a2b-4ff9-a06a-e43d55e96c87 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:46.660870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b7013542-2a2b-4ff9-a06a-e43d55e96c87 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:46.670312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b7013542-2a2b-4ff9-a06a-e43d55e96c87 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1510 microversion: 2.1 time: 0.297255 Jul 01 07:10:46.671368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 160/309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:46 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:47.236798 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bdc85bef-2b96-4913-a80a-5c872e6337f8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:47.237717 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bdc85bef-2b96-4913-a80a-5c872e6337f8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:47.243858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bdc85bef-2b96-4913-a80a-5c872e6337f8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:47.244314 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bdc85bef-2b96-4913-a80a-5c872e6337f8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:47.245087 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bdc85bef-2b96-4913-a80a-5c872e6337f8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:47.245810 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bdc85bef-2b96-4913-a80a-5c872e6337f8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:47.346284 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bdc85bef-2b96-4913-a80a-5c872e6337f8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:47.363866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bdc85bef-2b96-4913-a80a-5c872e6337f8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1266 microversion: 2.1 time: 0.132563 Jul 01 07:10:47.365015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 150/310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:47 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:10:47.695512 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4109be97-71ae-4efe-b1e1-3acff9e15c6d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:47.696868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4109be97-71ae-4efe-b1e1-3acff9e15c6d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:47.705083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4109be97-71ae-4efe-b1e1-3acff9e15c6d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:47.706217 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4109be97-71ae-4efe-b1e1-3acff9e15c6d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:47.711127 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4109be97-71ae-4efe-b1e1-3acff9e15c6d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:47.711911 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4109be97-71ae-4efe-b1e1-3acff9e15c6d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:47.978805 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4109be97-71ae-4efe-b1e1-3acff9e15c6d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:47.988056 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4109be97-71ae-4efe-b1e1-3acff9e15c6d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1510 microversion: 2.1 time: 0.302716 Jul 01 07:10:47.988688 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 161/311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:47 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1510 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:10:48.383570 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d7f65824-24c3-4a94-bf1b-2305e898f56f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:48.384229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d7f65824-24c3-4a94-bf1b-2305e898f56f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:48.392569 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d7f65824-24c3-4a94-bf1b-2305e898f56f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:48.393004 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d7f65824-24c3-4a94-bf1b-2305e898f56f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:48.393951 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d7f65824-24c3-4a94-bf1b-2305e898f56f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:48.394377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d7f65824-24c3-4a94-bf1b-2305e898f56f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:48.583141 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d7f65824-24c3-4a94-bf1b-2305e898f56f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:48.596237 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d7f65824-24c3-4a94-bf1b-2305e898f56f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.216568 Jul 01 07:10:48.596812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 151/312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:48 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:49.006392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-70e7cfac-ac59-4b83-ba51-55c2f3db8caf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:49.007077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-70e7cfac-ac59-4b83-ba51-55c2f3db8caf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:49.015451 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70e7cfac-ac59-4b83-ba51-55c2f3db8caf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:49.015451 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70e7cfac-ac59-4b83-ba51-55c2f3db8caf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:49.015451 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70e7cfac-ac59-4b83-ba51-55c2f3db8caf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:49.016138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70e7cfac-ac59-4b83-ba51-55c2f3db8caf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:49.181921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-70e7cfac-ac59-4b83-ba51-55c2f3db8caf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:49.190584 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-70e7cfac-ac59-4b83-ba51-55c2f3db8caf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1510 microversion: 2.1 time: 0.188179 Jul 01 07:10:49.200384 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 162/313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:49 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:49.614392 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6026acf0-9281-4db5-86a5-9ddc3acfa3fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:49.615074 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6026acf0-9281-4db5-86a5-9ddc3acfa3fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:49.621928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6026acf0-9281-4db5-86a5-9ddc3acfa3fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:49.622384 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6026acf0-9281-4db5-86a5-9ddc3acfa3fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:49.623189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6026acf0-9281-4db5-86a5-9ddc3acfa3fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:49.623634 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6026acf0-9281-4db5-86a5-9ddc3acfa3fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:49.772139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6026acf0-9281-4db5-86a5-9ddc3acfa3fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:49.780173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6026acf0-9281-4db5-86a5-9ddc3acfa3fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.169851 Jul 01 07:10:49.780737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 152/314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:49 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:50.208623 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-29f07595-7d61-4796-85d9-1ab60842cbfc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:50.209286 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-29f07595-7d61-4796-85d9-1ab60842cbfc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:50.211172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=30 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:50.216759 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-29f07595-7d61-4796-85d9-1ab60842cbfc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:50.217208 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-29f07595-7d61-4796-85d9-1ab60842cbfc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:50.217975 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-29f07595-7d61-4796-85d9-1ab60842cbfc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:50.218739 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-29f07595-7d61-4796-85d9-1ab60842cbfc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:50.347740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-29f07595-7d61-4796-85d9-1ab60842cbfc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:50.355119 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-29f07595-7d61-4796-85d9-1ab60842cbfc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1510 microversion: 2.1 time: 0.150705 Jul 01 07:10:50.355673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 163/315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:50 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:50.798288 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-aba6d083-7e55-4073-812e-6fcee7dc4272 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:50.798831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-aba6d083-7e55-4073-812e-6fcee7dc4272 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:50.805302 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-aba6d083-7e55-4073-812e-6fcee7dc4272 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:50.805757 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-aba6d083-7e55-4073-812e-6fcee7dc4272 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:50.806521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-aba6d083-7e55-4073-812e-6fcee7dc4272 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:50.806997 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-aba6d083-7e55-4073-812e-6fcee7dc4272 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:50.941924 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-aba6d083-7e55-4073-812e-6fcee7dc4272 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:50.949323 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-aba6d083-7e55-4073-812e-6fcee7dc4272 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.155572 Jul 01 07:10:50.949871 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 153/316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:50 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:51.372669 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c0fa9545-5e0e-497e-a627-9a8109e97fa1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:51.373477 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c0fa9545-5e0e-497e-a627-9a8109e97fa1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:51.381158 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0fa9545-5e0e-497e-a627-9a8109e97fa1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:51.381604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0fa9545-5e0e-497e-a627-9a8109e97fa1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:51.382536 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0fa9545-5e0e-497e-a627-9a8109e97fa1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:51.383095 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0fa9545-5e0e-497e-a627-9a8109e97fa1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:51.595169 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c0fa9545-5e0e-497e-a627-9a8109e97fa1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:51.603562 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c0fa9545-5e0e-497e-a627-9a8109e97fa1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1510 microversion: 2.1 time: 0.233717 Jul 01 07:10:51.603562 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 164/317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:51 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:51.919611 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-2580b84c-efd0-4d91-8651-e75c236ef78f req-5e027495-8c1f-4cbc-8a35-ce1cb1ac227b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8394dc3e-ffc0-4669-a5e3-a0f38609bb1e", "tag": "55758cc6-4eaa-4ad5-b20b-1ff5911b9866"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:51.936299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-2580b84c-efd0-4d91-8651-e75c236ef78f req-5e027495-8c1f-4cbc-8a35-ce1cb1ac227b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:51.936978 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-2580b84c-efd0-4d91-8651-e75c236ef78f req-5e027495-8c1f-4cbc-8a35-ce1cb1ac227b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:51.949037 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-2580b84c-efd0-4d91-8651-e75c236ef78f req-5e027495-8c1f-4cbc-8a35-ce1cb1ac227b service nova] Creating event network-changed:55758cc6-4eaa-4ad5-b20b-1ff5911b9866 for instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e on hv-cinder-80721 Jul 01 07:10:51.953793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-2580b84c-efd0-4d91-8651-e75c236ef78f req-5e027495-8c1f-4cbc-8a35-ce1cb1ac227b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037902 Jul 01 07:10:51.954366 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 154/318] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:10:51.965484 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5a477386-fdb5-406a-9666-3558be782ced tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:51.966122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5a477386-fdb5-406a-9666-3558be782ced tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:51.972473 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a477386-fdb5-406a-9666-3558be782ced tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:51.972931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a477386-fdb5-406a-9666-3558be782ced tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:51.973681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a477386-fdb5-406a-9666-3558be782ced tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:51.974118 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a477386-fdb5-406a-9666-3558be782ced tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:52.102057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5a477386-fdb5-406a-9666-3558be782ced tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:52.110015 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5a477386-fdb5-406a-9666-3558be782ced tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.148463 Jul 01 07:10:52.110578 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 165/319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:51 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:10:52.621107 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8e014ba0-69fb-4de8-97f1-dc39451aad4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:52.621791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8e014ba0-69fb-4de8-97f1-dc39451aad4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:52.627976 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8e014ba0-69fb-4de8-97f1-dc39451aad4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:52.628419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8e014ba0-69fb-4de8-97f1-dc39451aad4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:52.629170 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8e014ba0-69fb-4de8-97f1-dc39451aad4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:52.629608 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8e014ba0-69fb-4de8-97f1-dc39451aad4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:52.830935 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8e014ba0-69fb-4de8-97f1-dc39451aad4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:52.834660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:52.840091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8e014ba0-69fb-4de8-97f1-dc39451aad4e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1516 microversion: 2.1 time: 0.223136 Jul 01 07:10:52.840829 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 155/320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:52 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:53.126461 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a3d06bbd-58ec-4717-bd01-1f20b7a1ebbd tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:53.127110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a3d06bbd-58ec-4717-bd01-1f20b7a1ebbd tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:53.135263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a3d06bbd-58ec-4717-bd01-1f20b7a1ebbd tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:53.135707 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a3d06bbd-58ec-4717-bd01-1f20b7a1ebbd tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:53.136470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a3d06bbd-58ec-4717-bd01-1f20b7a1ebbd tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:53.136897 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a3d06bbd-58ec-4717-bd01-1f20b7a1ebbd tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:53.358013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a3d06bbd-58ec-4717-bd01-1f20b7a1ebbd tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:53.366317 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a3d06bbd-58ec-4717-bd01-1f20b7a1ebbd tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.243700 Jul 01 07:10:53.367292 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 166/321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:53 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:54.235396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3eccc9e5-5a41-4f02-adc1-0ded1fe6be81 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'create', calling method: .version_select at 0x7f2c4a682430>, body: {"keypair": {"name": "tempest-keypair-988787965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWLp6kEjVv7f2c6nnO0MxfYx1ZiJ9SHaKHEEK549snfSL9tYkhpJVI8Z6mabQovy8+Y4BWRFpPv3FILWsQiHgpXfPS6lWhJUn/95bBP6IEXpLJbEvTnUWBos0c+GF69pg=="}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:54.253001 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-3eccc9e5-5a41-4f02-adc1-0ded1fe6be81 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Getting quotas for project d94c1c234804421487c49cc9df6ff888. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:10:54.256814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-3eccc9e5-5a41-4f02-adc1-0ded1fe6be81 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Getting quotas for user 4549c33736bc413a87460db0c43f5768 and project d94c1c234804421487c49cc9df6ff888. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:10:54.278149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3eccc9e5-5a41-4f02-adc1-0ded1fe6be81 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047489 Jul 01 07:10:54.278734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 156/322] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:10:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:10:54.383757 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ccd1ed47-e660-41da-a00f-2fa70254dd7d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:54.384530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ccd1ed47-e660-41da-a00f-2fa70254dd7d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:54.390548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ccd1ed47-e660-41da-a00f-2fa70254dd7d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:54.391174 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ccd1ed47-e660-41da-a00f-2fa70254dd7d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:54.392058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ccd1ed47-e660-41da-a00f-2fa70254dd7d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:54.392593 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ccd1ed47-e660-41da-a00f-2fa70254dd7d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:54.566108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ccd1ed47-e660-41da-a00f-2fa70254dd7d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:54.575806 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ccd1ed47-e660-41da-a00f-2fa70254dd7d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.196120 Jul 01 07:10:54.576385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 167/323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:54 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:55.592830 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-124684cf-42d3-429d-99cb-4e1017270ed3 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:55.593430 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-124684cf-42d3-429d-99cb-4e1017270ed3 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:55.599956 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-124684cf-42d3-429d-99cb-4e1017270ed3 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:55.600407 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-124684cf-42d3-429d-99cb-4e1017270ed3 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:55.601361 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-124684cf-42d3-429d-99cb-4e1017270ed3 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:55.601949 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-124684cf-42d3-429d-99cb-4e1017270ed3 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:55.707768 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-575217414", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "736f268f-40b8-4ff4-91ad-a9795eb5f897"}], "security_groups": [{"name": "tempest-securitygroup--2098757876"}], "key_name": "tempest-keypair-988787965", "user_data": "}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:10:55.735878 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-124684cf-42d3-429d-99cb-4e1017270ed3 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:55.743960 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-124684cf-42d3-429d-99cb-4e1017270ed3 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.155328 Jul 01 07:10:55.744529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 157/324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:55 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:55.814144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] validate_networks() for [('736f268f-40b8-4ff4-91ad-a9795eb5f897', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:10:56.419050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:10:56.420002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:10:56.420587 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:10:56.421073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:10:56.421573 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:10:56.432830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:56.433284 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:56.438253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:56.438717 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:56.460597 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Getting quotas for project d94c1c234804421487c49cc9df6ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:10:56.465921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Getting quotas for user 4549c33736bc413a87460db0c43f5768 and project d94c1c234804421487c49cc9df6ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:10:56.479997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:10:56.483615 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:10:56.578287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-79462ab9-1afb-4cc6-b92e-b219fae7267b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.874683 Jul 01 07:10:56.579462 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 168/325] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:10:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 07:10:56.591621 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d55a59af-98d6-42d5-ac3a-cde3e15140ae tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:56.592234 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d55a59af-98d6-42d5-ac3a-cde3e15140ae tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:56.596010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:56.660544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d55a59af-98d6-42d5-ac3a-cde3e15140ae tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:56.668158 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d55a59af-98d6-42d5-ac3a-cde3e15140ae tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1244 microversion: 2.1 time: 0.083159 Jul 01 07:10:56.669482 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 158/326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:56 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:56.761970 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b3cde846-177d-416a-8a6d-77d7e1c83e69 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:56.762578 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b3cde846-177d-416a-8a6d-77d7e1c83e69 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:56.768721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b3cde846-177d-416a-8a6d-77d7e1c83e69 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:56.769173 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b3cde846-177d-416a-8a6d-77d7e1c83e69 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:56.769930 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b3cde846-177d-416a-8a6d-77d7e1c83e69 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:56.770364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b3cde846-177d-416a-8a6d-77d7e1c83e69 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:56.909072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b3cde846-177d-416a-8a6d-77d7e1c83e69 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:56.916502 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b3cde846-177d-416a-8a6d-77d7e1c83e69 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.158760 Jul 01 07:10:56.917058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 169/327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:56 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:57.685668 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-755191dd-f873-4280-b56a-179f90cafb5c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:57.686281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-755191dd-f873-4280-b56a-179f90cafb5c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:57.722865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-755191dd-f873-4280-b56a-179f90cafb5c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:57.724821 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-755191dd-f873-4280-b56a-179f90cafb5c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:57.725988 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-755191dd-f873-4280-b56a-179f90cafb5c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:57.726443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-755191dd-f873-4280-b56a-179f90cafb5c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:57.846865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-755191dd-f873-4280-b56a-179f90cafb5c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:57.854719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-755191dd-f873-4280-b56a-179f90cafb5c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1304 microversion: 2.1 time: 0.173171 Jul 01 07:10:57.868710 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 159/328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:57 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:57.934497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-139628eb-944e-4d74-b43b-ddc7a3ebc41b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:57.934497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-139628eb-944e-4d74-b43b-ddc7a3ebc41b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:57.940679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-139628eb-944e-4d74-b43b-ddc7a3ebc41b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:57.941619 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-139628eb-944e-4d74-b43b-ddc7a3ebc41b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:57.941934 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-139628eb-944e-4d74-b43b-ddc7a3ebc41b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:57.942370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-139628eb-944e-4d74-b43b-ddc7a3ebc41b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:58.089794 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-139628eb-944e-4d74-b43b-ddc7a3ebc41b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:58.099874 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-139628eb-944e-4d74-b43b-ddc7a3ebc41b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.170274 Jul 01 07:10:58.100444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 170/329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:57 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:58.874672 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3970c5d2-ef24-492d-b9a4-e4c00946b331 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:58.875382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3970c5d2-ef24-492d-b9a4-e4c00946b331 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:58.884198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3970c5d2-ef24-492d-b9a4-e4c00946b331 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:58.884651 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3970c5d2-ef24-492d-b9a4-e4c00946b331 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:58.885412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3970c5d2-ef24-492d-b9a4-e4c00946b331 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:58.885845 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3970c5d2-ef24-492d-b9a4-e4c00946b331 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:58.953723 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3970c5d2-ef24-492d-b9a4-e4c00946b331 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:58.961790 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3970c5d2-ef24-492d-b9a4-e4c00946b331 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1302 microversion: 2.1 time: 0.090970 Jul 01 07:10:58.962353 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 160/330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:58 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:59.116481 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6c22acdc-95b0-4a36-9c68-e3bc5957cd6e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:59.117091 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6c22acdc-95b0-4a36-9c68-e3bc5957cd6e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:59.123206 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6c22acdc-95b0-4a36-9c68-e3bc5957cd6e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:59.123655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6c22acdc-95b0-4a36-9c68-e3bc5957cd6e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:59.124439 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6c22acdc-95b0-4a36-9c68-e3bc5957cd6e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:59.124868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6c22acdc-95b0-4a36-9c68-e3bc5957cd6e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:59.258845 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6c22acdc-95b0-4a36-9c68-e3bc5957cd6e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:10:59.266429 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6c22acdc-95b0-4a36-9c68-e3bc5957cd6e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.153765 Jul 01 07:10:59.267006 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 171/331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:59 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:10:59.978561 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-26247f4e-727a-4b76-9209-72c7e15a0865 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:10:59.979210 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-26247f4e-727a-4b76-9209-72c7e15a0865 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:10:59.981467 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:10:59.986653 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-26247f4e-727a-4b76-9209-72c7e15a0865 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:59.987122 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-26247f4e-727a-4b76-9209-72c7e15a0865 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:10:59.987881 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-26247f4e-727a-4b76-9209-72c7e15a0865 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:10:59.988321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-26247f4e-727a-4b76-9209-72c7e15a0865 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:00.053049 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-26247f4e-727a-4b76-9209-72c7e15a0865 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:00.060588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-26247f4e-727a-4b76-9209-72c7e15a0865 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1302 microversion: 2.1 time: 0.085953 Jul 01 07:11:00.061134 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 161/332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:10:59 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:00.284033 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8576124f-238a-4652-a989-39f3b3bdb0af tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:00.284641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8576124f-238a-4652-a989-39f3b3bdb0af tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:00.290551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8576124f-238a-4652-a989-39f3b3bdb0af tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:00.291031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8576124f-238a-4652-a989-39f3b3bdb0af tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:00.291788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8576124f-238a-4652-a989-39f3b3bdb0af tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:00.292220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8576124f-238a-4652-a989-39f3b3bdb0af tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:00.417023 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8576124f-238a-4652-a989-39f3b3bdb0af tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:00.424794 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8576124f-238a-4652-a989-39f3b3bdb0af tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.144572 Jul 01 07:11:00.425351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 172/333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:00 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:01.077294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6a3b9414-1141-4722-b255-a2c6044d8717 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:01.077895 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6a3b9414-1141-4722-b255-a2c6044d8717 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:01.084828 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6a3b9414-1141-4722-b255-a2c6044d8717 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:01.085276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6a3b9414-1141-4722-b255-a2c6044d8717 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:01.086023 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6a3b9414-1141-4722-b255-a2c6044d8717 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:01.086477 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6a3b9414-1141-4722-b255-a2c6044d8717 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:01.145699 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6a3b9414-1141-4722-b255-a2c6044d8717 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:01.152870 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6a3b9414-1141-4722-b255-a2c6044d8717 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1302 microversion: 2.1 time: 0.079382 Jul 01 07:11:01.153415 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 162/334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:01 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1302 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:01.442877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-78d39480-850e-4a74-99a4-67d65d2e4c0f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:01.443881 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-78d39480-850e-4a74-99a4-67d65d2e4c0f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:01.450525 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-78d39480-850e-4a74-99a4-67d65d2e4c0f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:01.451014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-78d39480-850e-4a74-99a4-67d65d2e4c0f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:01.451778 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-78d39480-850e-4a74-99a4-67d65d2e4c0f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:01.452207 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-78d39480-850e-4a74-99a4-67d65d2e4c0f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:01.582451 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-78d39480-850e-4a74-99a4-67d65d2e4c0f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:01.589836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-78d39480-850e-4a74-99a4-67d65d2e4c0f tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.152273 Jul 01 07:11:01.590392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 173/335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:01 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:02.170024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-12198ded-bab3-4180-8be3-b2271041fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:02.170586 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-12198ded-bab3-4180-8be3-b2271041fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:02.177575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-12198ded-bab3-4180-8be3-b2271041fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:02.178056 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-12198ded-bab3-4180-8be3-b2271041fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:02.178848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-12198ded-bab3-4180-8be3-b2271041fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:02.179287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-12198ded-bab3-4180-8be3-b2271041fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:02.240156 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-12198ded-bab3-4180-8be3-b2271041fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:02.247514 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-12198ded-bab3-4180-8be3-b2271041fb9f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1302 microversion: 2.1 time: 0.081453 Jul 01 07:11:02.248064 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 163/336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:02 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:02.606358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5e6fe867-3a33-4345-b53a-eae1a925dc47 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:02.607078 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5e6fe867-3a33-4345-b53a-eae1a925dc47 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:02.612964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5e6fe867-3a33-4345-b53a-eae1a925dc47 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:02.613408 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5e6fe867-3a33-4345-b53a-eae1a925dc47 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:02.614162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5e6fe867-3a33-4345-b53a-eae1a925dc47 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:02.614593 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5e6fe867-3a33-4345-b53a-eae1a925dc47 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:02.739511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5e6fe867-3a33-4345-b53a-eae1a925dc47 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:02.741653 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:02.748176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5e6fe867-3a33-4345-b53a-eae1a925dc47 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.145650 Jul 01 07:11:02.748728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 174/337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:02 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:03.264307 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ad84ad4a-15d5-4b05-aa32-95c357888823 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:03.265045 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ad84ad4a-15d5-4b05-aa32-95c357888823 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:03.271647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ad84ad4a-15d5-4b05-aa32-95c357888823 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:03.272169 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ad84ad4a-15d5-4b05-aa32-95c357888823 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:03.273002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ad84ad4a-15d5-4b05-aa32-95c357888823 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:03.273507 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ad84ad4a-15d5-4b05-aa32-95c357888823 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:03.344041 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ad84ad4a-15d5-4b05-aa32-95c357888823 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:03.351384 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ad84ad4a-15d5-4b05-aa32-95c357888823 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1302 microversion: 2.1 time: 0.090913 Jul 01 07:11:03.351941 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 164/338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:03 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:03.767227 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-65719c89-c8f0-446a-9066-f33d34a29aca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:03.767614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-65719c89-c8f0-446a-9066-f33d34a29aca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:03.774449 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-65719c89-c8f0-446a-9066-f33d34a29aca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:03.774920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-65719c89-c8f0-446a-9066-f33d34a29aca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:03.775989 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-65719c89-c8f0-446a-9066-f33d34a29aca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:03.776495 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-65719c89-c8f0-446a-9066-f33d34a29aca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:04.000704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-65719c89-c8f0-446a-9066-f33d34a29aca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:04.009063 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-65719c89-c8f0-446a-9066-f33d34a29aca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.247545 Jul 01 07:11:04.009876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 175/339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:03 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:04.369035 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-06a97ab6-6127-447c-82f8-aaae1ff7e1d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:04.370171 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-06a97ab6-6127-447c-82f8-aaae1ff7e1d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:04.376901 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-06a97ab6-6127-447c-82f8-aaae1ff7e1d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:04.377344 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-06a97ab6-6127-447c-82f8-aaae1ff7e1d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:04.378109 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-06a97ab6-6127-447c-82f8-aaae1ff7e1d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:04.378538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-06a97ab6-6127-447c-82f8-aaae1ff7e1d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:04.569212 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-349b4859-4e1d-477b-b0fc-31ef575e2da9 req-d6ba86f0-de25-4de5-a707-b657ad1feca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0721e7-9239-4832-b6dc-329e0682e8c6", "tag": "55005d37-c17f-4cd9-ba0e-3e7034d6e963"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:04.577804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-349b4859-4e1d-477b-b0fc-31ef575e2da9 req-d6ba86f0-de25-4de5-a707-b657ad1feca8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:04.578510 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-349b4859-4e1d-477b-b0fc-31ef575e2da9 req-d6ba86f0-de25-4de5-a707-b657ad1feca8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:04.590645 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-349b4859-4e1d-477b-b0fc-31ef575e2da9 req-d6ba86f0-de25-4de5-a707-b657ad1feca8 service nova] Creating event network-changed:55005d37-c17f-4cd9-ba0e-3e7034d6e963 for instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 on hv-cinder-80721 Jul 01 07:11:04.596618 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-349b4859-4e1d-477b-b0fc-31ef575e2da9 req-d6ba86f0-de25-4de5-a707-b657ad1feca8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030486 Jul 01 07:11:04.597733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 176/340] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:11:04.601809 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-06a97ab6-6127-447c-82f8-aaae1ff7e1d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:04.610306 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-06a97ab6-6127-447c-82f8-aaae1ff7e1d7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.245535 Jul 01 07:11:04.610903 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 165/341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:04 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:05.026798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5a95fae5-8e72-4bdd-8294-cd9604e80989 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:05.027503 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5a95fae5-8e72-4bdd-8294-cd9604e80989 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:05.034172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a95fae5-8e72-4bdd-8294-cd9604e80989 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:05.034616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a95fae5-8e72-4bdd-8294-cd9604e80989 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:05.035386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a95fae5-8e72-4bdd-8294-cd9604e80989 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:05.035812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a95fae5-8e72-4bdd-8294-cd9604e80989 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:05.161163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5a95fae5-8e72-4bdd-8294-cd9604e80989 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:05.168502 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5a95fae5-8e72-4bdd-8294-cd9604e80989 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.145878 Jul 01 07:11:05.169093 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 177/342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:05 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:05.626175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c3cd85c-67c4-4994-a54f-f1cd976cb5b0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:05.626820 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1c3cd85c-67c4-4994-a54f-f1cd976cb5b0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:05.633265 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1c3cd85c-67c4-4994-a54f-f1cd976cb5b0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:05.633704 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1c3cd85c-67c4-4994-a54f-f1cd976cb5b0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:05.634453 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1c3cd85c-67c4-4994-a54f-f1cd976cb5b0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:05.634918 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1c3cd85c-67c4-4994-a54f-f1cd976cb5b0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:05.759301 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1c3cd85c-67c4-4994-a54f-f1cd976cb5b0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:05.766419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c3cd85c-67c4-4994-a54f-f1cd976cb5b0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.144100 Jul 01 07:11:05.767004 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 166/343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:05 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:06.186089 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fdb79f68-e01e-4ea7-a783-b2ccb06da3c4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:06.186702 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fdb79f68-e01e-4ea7-a783-b2ccb06da3c4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:06.193452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fdb79f68-e01e-4ea7-a783-b2ccb06da3c4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:06.193899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fdb79f68-e01e-4ea7-a783-b2ccb06da3c4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:06.194663 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fdb79f68-e01e-4ea7-a783-b2ccb06da3c4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:06.195122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fdb79f68-e01e-4ea7-a783-b2ccb06da3c4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:06.323538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fdb79f68-e01e-4ea7-a783-b2ccb06da3c4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:06.331712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fdb79f68-e01e-4ea7-a783-b2ccb06da3c4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.149549 Jul 01 07:11:06.332348 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 178/344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:06 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:06.784067 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1f84e8a0-3a9e-4924-b46f-6cb4c0890673 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:06.784607 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1f84e8a0-3a9e-4924-b46f-6cb4c0890673 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:06.786931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=18 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:06.792484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1f84e8a0-3a9e-4924-b46f-6cb4c0890673 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:06.792926 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1f84e8a0-3a9e-4924-b46f-6cb4c0890673 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:06.793779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1f84e8a0-3a9e-4924-b46f-6cb4c0890673 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:06.794215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1f84e8a0-3a9e-4924-b46f-6cb4c0890673 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:06.922102 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1f84e8a0-3a9e-4924-b46f-6cb4c0890673 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:06.929493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1f84e8a0-3a9e-4924-b46f-6cb4c0890673 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.149890 Jul 01 07:11:06.930052 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 167/345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:06 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:07.348871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-80ae03a9-dfd1-47b0-81f6-720f99d030b7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:07.349422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-80ae03a9-dfd1-47b0-81f6-720f99d030b7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:07.351372 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:07.352020 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=6 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:07.357696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-80ae03a9-dfd1-47b0-81f6-720f99d030b7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:07.358137 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-80ae03a9-dfd1-47b0-81f6-720f99d030b7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:07.358918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-80ae03a9-dfd1-47b0-81f6-720f99d030b7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:07.359349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-80ae03a9-dfd1-47b0-81f6-720f99d030b7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:07.491928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-80ae03a9-dfd1-47b0-81f6-720f99d030b7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:07.499714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-80ae03a9-dfd1-47b0-81f6-720f99d030b7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.154956 Jul 01 07:11:07.500275 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 179/346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:07 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:07.946487 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-24818080-0744-4658-99e1-40815ca8c2b5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:07.947085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-24818080-0744-4658-99e1-40815ca8c2b5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:07.953479 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24818080-0744-4658-99e1-40815ca8c2b5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:07.953918 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24818080-0744-4658-99e1-40815ca8c2b5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:07.954665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24818080-0744-4658-99e1-40815ca8c2b5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:07.955121 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24818080-0744-4658-99e1-40815ca8c2b5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:08.083430 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-24818080-0744-4658-99e1-40815ca8c2b5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:08.090612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-24818080-0744-4658-99e1-40815ca8c2b5 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.148096 Jul 01 07:11:08.091186 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 168/347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:07 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:08.516859 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5b515462-6373-4cd7-ab6d-01e03478b9fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:08.517646 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5b515462-6373-4cd7-ab6d-01e03478b9fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:08.523819 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b515462-6373-4cd7-ab6d-01e03478b9fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:08.524274 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b515462-6373-4cd7-ab6d-01e03478b9fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:08.525052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b515462-6373-4cd7-ab6d-01e03478b9fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:08.525492 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b515462-6373-4cd7-ab6d-01e03478b9fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:08.675131 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5b515462-6373-4cd7-ab6d-01e03478b9fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:08.682839 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5b515462-6373-4cd7-ab6d-01e03478b9fc tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.169810 Jul 01 07:11:08.683394 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 180/348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:08 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:09.107867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d6980249-6714-400c-a5c9-827d7c06708a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:09.108442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d6980249-6714-400c-a5c9-827d7c06708a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:09.114883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d6980249-6714-400c-a5c9-827d7c06708a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:09.115329 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d6980249-6714-400c-a5c9-827d7c06708a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:09.116102 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d6980249-6714-400c-a5c9-827d7c06708a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:09.116521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d6980249-6714-400c-a5c9-827d7c06708a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:09.344469 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d6980249-6714-400c-a5c9-827d7c06708a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:09.352882 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d6980249-6714-400c-a5c9-827d7c06708a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.248492 Jul 01 07:11:09.357943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 169/349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:09 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:09.504619 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-dd81f733-a8b7-48d3-88a3-8521c237d155 req-d4a2ee3b-c2e8-40f7-a8e5-0290d66226ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8394dc3e-ffc0-4669-a5e3-a0f38609bb1e", "name": "network-vif-plugged", "status": "completed", "tag": "55758cc6-4eaa-4ad5-b20b-1ff5911b9866"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:09.514240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-dd81f733-a8b7-48d3-88a3-8521c237d155 req-d4a2ee3b-c2e8-40f7-a8e5-0290d66226ee service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:09.514691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-dd81f733-a8b7-48d3-88a3-8521c237d155 req-d4a2ee3b-c2e8-40f7-a8e5-0290d66226ee service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:09.526736 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-dd81f733-a8b7-48d3-88a3-8521c237d155 req-d4a2ee3b-c2e8-40f7-a8e5-0290d66226ee service nova] Creating event network-vif-plugged:55758cc6-4eaa-4ad5-b20b-1ff5911b9866 for instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e on hv-cinder-80721 Jul 01 07:11:09.531697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-dd81f733-a8b7-48d3-88a3-8521c237d155 req-d4a2ee3b-c2e8-40f7-a8e5-0290d66226ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031564 Jul 01 07:11:09.532273 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 181/350] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:11:09.700476 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-731c1056-37e6-4807-b95d-7067e00a878e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:09.701216 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-731c1056-37e6-4807-b95d-7067e00a878e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:09.707757 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-731c1056-37e6-4807-b95d-7067e00a878e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:09.708209 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-731c1056-37e6-4807-b95d-7067e00a878e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:09.708961 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-731c1056-37e6-4807-b95d-7067e00a878e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:09.709397 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-731c1056-37e6-4807-b95d-7067e00a878e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:09.834479 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-731c1056-37e6-4807-b95d-7067e00a878e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:09.841830 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-731c1056-37e6-4807-b95d-7067e00a878e tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.145200 Jul 01 07:11:09.842386 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 170/351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:09 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:10.369738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2e2586e5-1817-4f84-9a1d-f03590437b9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:10.370460 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2e2586e5-1817-4f84-9a1d-f03590437b9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:10.376561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2e2586e5-1817-4f84-9a1d-f03590437b9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:10.377009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2e2586e5-1817-4f84-9a1d-f03590437b9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:10.377761 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2e2586e5-1817-4f84-9a1d-f03590437b9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:10.378187 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2e2586e5-1817-4f84-9a1d-f03590437b9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:10.504306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2e2586e5-1817-4f84-9a1d-f03590437b9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:10.511663 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2e2586e5-1817-4f84-9a1d-f03590437b9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.146145 Jul 01 07:11:10.512218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 182/352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:10 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:10.858427 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-341f35ab-1d87-4265-a26f-de9473da68db tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:10.859101 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-341f35ab-1d87-4265-a26f-de9473da68db tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:10.865517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-341f35ab-1d87-4265-a26f-de9473da68db tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:10.865966 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-341f35ab-1d87-4265-a26f-de9473da68db tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:10.866728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-341f35ab-1d87-4265-a26f-de9473da68db tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:10.867193 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-341f35ab-1d87-4265-a26f-de9473da68db tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:10.995409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-341f35ab-1d87-4265-a26f-de9473da68db tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:11.003339 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-341f35ab-1d87-4265-a26f-de9473da68db tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.148748 Jul 01 07:11:11.003929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 171/353] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:10 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:11.528410 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1bd9e6fb-4120-4f10-ba58-3ec34507ef23 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:11.528928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1bd9e6fb-4120-4f10-ba58-3ec34507ef23 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:11.534883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1bd9e6fb-4120-4f10-ba58-3ec34507ef23 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:11.535323 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1bd9e6fb-4120-4f10-ba58-3ec34507ef23 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:11.536102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1bd9e6fb-4120-4f10-ba58-3ec34507ef23 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:11.536525 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1bd9e6fb-4120-4f10-ba58-3ec34507ef23 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:11.664102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1bd9e6fb-4120-4f10-ba58-3ec34507ef23 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:11.671588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1bd9e6fb-4120-4f10-ba58-3ec34507ef23 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.147033 Jul 01 07:11:11.672152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 183/354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:11 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:12.021507 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-88676161-4d32-48ac-a6ac-50884a53fa54 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:12.022112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-88676161-4d32-48ac-a6ac-50884a53fa54 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:12.028521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-88676161-4d32-48ac-a6ac-50884a53fa54 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:12.028966 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-88676161-4d32-48ac-a6ac-50884a53fa54 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:12.029727 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-88676161-4d32-48ac-a6ac-50884a53fa54 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:12.030160 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-88676161-4d32-48ac-a6ac-50884a53fa54 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:12.157509 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-88676161-4d32-48ac-a6ac-50884a53fa54 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:12.164856 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-88676161-4d32-48ac-a6ac-50884a53fa54 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.148306 Jul 01 07:11:12.165418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 172/355] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:12 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:12.690056 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-188433c3-571d-4a98-9fb1-84a897b7b411 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:12.690669 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-188433c3-571d-4a98-9fb1-84a897b7b411 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:12.696728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-188433c3-571d-4a98-9fb1-84a897b7b411 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:12.697114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-188433c3-571d-4a98-9fb1-84a897b7b411 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:12.697867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-188433c3-571d-4a98-9fb1-84a897b7b411 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:12.698295 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-188433c3-571d-4a98-9fb1-84a897b7b411 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:12.821649 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-188433c3-571d-4a98-9fb1-84a897b7b411 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:12.829105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-188433c3-571d-4a98-9fb1-84a897b7b411 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.142977 Jul 01 07:11:12.830164 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 184/356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:12 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:13.181622 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ee9a32f7-c96d-40ac-ae65-4bc7d7cfec46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:13.182255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ee9a32f7-c96d-40ac-ae65-4bc7d7cfec46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:13.188705 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee9a32f7-c96d-40ac-ae65-4bc7d7cfec46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:13.189751 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee9a32f7-c96d-40ac-ae65-4bc7d7cfec46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:13.190425 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee9a32f7-c96d-40ac-ae65-4bc7d7cfec46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:13.190911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee9a32f7-c96d-40ac-ae65-4bc7d7cfec46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:13.325261 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ee9a32f7-c96d-40ac-ae65-4bc7d7cfec46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:13.333270 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ee9a32f7-c96d-40ac-ae65-4bc7d7cfec46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.155383 Jul 01 07:11:13.333823 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 173/357] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:13 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:13.846573 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d59f652b-1f6f-49d6-9283-8d2662864a0e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:13.847154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d59f652b-1f6f-49d6-9283-8d2662864a0e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:13.853048 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d59f652b-1f6f-49d6-9283-8d2662864a0e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:13.853485 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d59f652b-1f6f-49d6-9283-8d2662864a0e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:13.854229 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d59f652b-1f6f-49d6-9283-8d2662864a0e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:13.854654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d59f652b-1f6f-49d6-9283-8d2662864a0e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:13.980791 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d59f652b-1f6f-49d6-9283-8d2662864a0e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:13.988105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d59f652b-1f6f-49d6-9283-8d2662864a0e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.146060 Jul 01 07:11:13.988655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 185/358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:13 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:14.349227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7367ac5d-40fa-40da-8884-b290b9e9b0c8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:14.349834 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7367ac5d-40fa-40da-8884-b290b9e9b0c8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:14.356780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7367ac5d-40fa-40da-8884-b290b9e9b0c8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:14.357229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7367ac5d-40fa-40da-8884-b290b9e9b0c8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:14.358018 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7367ac5d-40fa-40da-8884-b290b9e9b0c8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:14.358448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7367ac5d-40fa-40da-8884-b290b9e9b0c8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:14.378696 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:14.492129 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7367ac5d-40fa-40da-8884-b290b9e9b0c8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:14.499701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7367ac5d-40fa-40da-8884-b290b9e9b0c8 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.154101 Jul 01 07:11:14.510934 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 174/359] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:14 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:15.004457 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1eafc92e-ec35-4d91-9f79-44270871c91f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:15.005062 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1eafc92e-ec35-4d91-9f79-44270871c91f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:15.010979 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1eafc92e-ec35-4d91-9f79-44270871c91f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:15.011423 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1eafc92e-ec35-4d91-9f79-44270871c91f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:15.012174 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1eafc92e-ec35-4d91-9f79-44270871c91f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:15.012598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1eafc92e-ec35-4d91-9f79-44270871c91f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:15.141377 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1eafc92e-ec35-4d91-9f79-44270871c91f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:15.149186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1eafc92e-ec35-4d91-9f79-44270871c91f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.148502 Jul 01 07:11:15.149741 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 186/360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:14 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:15.516577 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0740389e-47f3-463b-aa24-06dace1fcbb2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:15.517845 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0740389e-47f3-463b-aa24-06dace1fcbb2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:15.524252 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0740389e-47f3-463b-aa24-06dace1fcbb2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:15.524699 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0740389e-47f3-463b-aa24-06dace1fcbb2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:15.525456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0740389e-47f3-463b-aa24-06dace1fcbb2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:15.525890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0740389e-47f3-463b-aa24-06dace1fcbb2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:15.660219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0740389e-47f3-463b-aa24-06dace1fcbb2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:15.667643 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0740389e-47f3-463b-aa24-06dace1fcbb2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.154957 Jul 01 07:11:15.668274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 175/361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:15 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:16.166208 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8225648e-7731-42e4-a95a-9265f54efcad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:16.166827 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8225648e-7731-42e4-a95a-9265f54efcad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:16.172730 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8225648e-7731-42e4-a95a-9265f54efcad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:16.173170 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8225648e-7731-42e4-a95a-9265f54efcad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:16.173955 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8225648e-7731-42e4-a95a-9265f54efcad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:16.174384 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8225648e-7731-42e4-a95a-9265f54efcad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:16.302924 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8225648e-7731-42e4-a95a-9265f54efcad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:16.310401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8225648e-7731-42e4-a95a-9265f54efcad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.147984 Jul 01 07:11:16.310976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 187/362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:16 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:16.684688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0f9294eb-998f-42b3-abf6-6dc6c906a32c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:16.685344 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0f9294eb-998f-42b3-abf6-6dc6c906a32c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:16.692353 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0f9294eb-998f-42b3-abf6-6dc6c906a32c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:16.692799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0f9294eb-998f-42b3-abf6-6dc6c906a32c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:16.693650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0f9294eb-998f-42b3-abf6-6dc6c906a32c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:16.694147 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0f9294eb-998f-42b3-abf6-6dc6c906a32c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:16.828504 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0f9294eb-998f-42b3-abf6-6dc6c906a32c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:16.839023 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0f9294eb-998f-42b3-abf6-6dc6c906a32c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.158424 Jul 01 07:11:16.839585 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 176/363] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:16 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:17.327490 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-570d9dde-9216-489f-9e4f-1fbf7f8c9b64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:17.328098 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-570d9dde-9216-489f-9e4f-1fbf7f8c9b64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:17.334530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-570d9dde-9216-489f-9e4f-1fbf7f8c9b64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:17.335016 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-570d9dde-9216-489f-9e4f-1fbf7f8c9b64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:17.335780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-570d9dde-9216-489f-9e4f-1fbf7f8c9b64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:17.336209 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-570d9dde-9216-489f-9e4f-1fbf7f8c9b64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:17.465241 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-570d9dde-9216-489f-9e4f-1fbf7f8c9b64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:17.473274 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-570d9dde-9216-489f-9e4f-1fbf7f8c9b64 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.149615 Jul 01 07:11:17.473860 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 188/364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:17 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:17.855575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9d71e9d5-1d11-423a-8cb0-596760f6f193 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:17.856283 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9d71e9d5-1d11-423a-8cb0-596760f6f193 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:17.862261 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9d71e9d5-1d11-423a-8cb0-596760f6f193 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:17.862710 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9d71e9d5-1d11-423a-8cb0-596760f6f193 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:17.863504 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9d71e9d5-1d11-423a-8cb0-596760f6f193 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:17.863945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9d71e9d5-1d11-423a-8cb0-596760f6f193 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:18.038101 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9d71e9d5-1d11-423a-8cb0-596760f6f193 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:18.049007 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9d71e9d5-1d11-423a-8cb0-596760f6f193 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1314 microversion: 2.1 time: 0.196506 Jul 01 07:11:18.054856 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 177/365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:17 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:18.490008 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5aadbb3a-78e8-4c74-9963-db0396407414 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:18.490596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5aadbb3a-78e8-4c74-9963-db0396407414 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:18.496798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5aadbb3a-78e8-4c74-9963-db0396407414 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:18.497252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5aadbb3a-78e8-4c74-9963-db0396407414 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:18.498031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5aadbb3a-78e8-4c74-9963-db0396407414 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:18.498465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5aadbb3a-78e8-4c74-9963-db0396407414 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:18.627949 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5aadbb3a-78e8-4c74-9963-db0396407414 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:18.635355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5aadbb3a-78e8-4c74-9963-db0396407414 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.149243 Jul 01 07:11:18.635923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 189/366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:18 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:19.066106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f617acc4-cd67-42f6-905a-7f21f47ba400 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:19.066720 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f617acc4-cd67-42f6-905a-7f21f47ba400 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:19.074010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f617acc4-cd67-42f6-905a-7f21f47ba400 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:19.074655 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f617acc4-cd67-42f6-905a-7f21f47ba400 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:19.075623 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f617acc4-cd67-42f6-905a-7f21f47ba400 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:19.076227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f617acc4-cd67-42f6-905a-7f21f47ba400 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:19.218092 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f617acc4-cd67-42f6-905a-7f21f47ba400 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:19.226741 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f617acc4-cd67-42f6-905a-7f21f47ba400 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1499 microversion: 2.1 time: 0.164998 Jul 01 07:11:19.227462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 178/367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:19 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:19.652578 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8caf524f-1cd5-457b-9091-4da964f6c566 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:19.653712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8caf524f-1cd5-457b-9091-4da964f6c566 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:19.659672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8caf524f-1cd5-457b-9091-4da964f6c566 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:19.660118 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8caf524f-1cd5-457b-9091-4da964f6c566 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:19.660878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8caf524f-1cd5-457b-9091-4da964f6c566 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:19.661310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8caf524f-1cd5-457b-9091-4da964f6c566 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:19.803951 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8caf524f-1cd5-457b-9091-4da964f6c566 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:19.812546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8caf524f-1cd5-457b-9091-4da964f6c566 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.163759 Jul 01 07:11:19.813172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 190/368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:19 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:19.843546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0897ac00-691c-438e-a24e-d279cd641cf2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:19.843938 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0897ac00-691c-438e-a24e-d279cd641cf2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:19.850256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0897ac00-691c-438e-a24e-d279cd641cf2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:19.850700 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0897ac00-691c-438e-a24e-d279cd641cf2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:19.857763 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0897ac00-691c-438e-a24e-d279cd641cf2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:19.858223 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0897ac00-691c-438e-a24e-d279cd641cf2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:19.886350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0897ac00-691c-438e-a24e-d279cd641cf2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:11:19.964793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0897ac00-691c-438e-a24e-d279cd641cf2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 204 len: 0 microversion: 2.1 time: 0.124668 Jul 01 07:11:19.966834 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 179/369] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:11:19 2022] DELETE /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:11:19.974738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9cbe4c20-ee6c-4993-b910-1f20177a5711 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:19.975724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9cbe4c20-ee6c-4993-b910-1f20177a5711 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:19.986657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9cbe4c20-ee6c-4993-b910-1f20177a5711 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:19.987157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9cbe4c20-ee6c-4993-b910-1f20177a5711 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:19.987927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9cbe4c20-ee6c-4993-b910-1f20177a5711 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:19.988363 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9cbe4c20-ee6c-4993-b910-1f20177a5711 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:20.136549 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9cbe4c20-ee6c-4993-b910-1f20177a5711 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:20.143966 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9cbe4c20-ee6c-4993-b910-1f20177a5711 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1505 microversion: 2.1 time: 0.173068 Jul 01 07:11:20.144733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 191/370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:19 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:20.378215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-283295a7-71f6-465a-bc83-4d29b75d6781 req-97dc6d3f-3e92-423e-a174-e4e363f98e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0721e7-9239-4832-b6dc-329e0682e8c6", "name": "network-vif-plugged", "status": "completed", "tag": "55005d37-c17f-4cd9-ba0e-3e7034d6e963"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:20.387185 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-283295a7-71f6-465a-bc83-4d29b75d6781 req-97dc6d3f-3e92-423e-a174-e4e363f98e5d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:20.387824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-283295a7-71f6-465a-bc83-4d29b75d6781 req-97dc6d3f-3e92-423e-a174-e4e363f98e5d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:20.399897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-283295a7-71f6-465a-bc83-4d29b75d6781 req-97dc6d3f-3e92-423e-a174-e4e363f98e5d service nova] Creating event network-vif-plugged:55005d37-c17f-4cd9-ba0e-3e7034d6e963 for instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 on hv-cinder-80721 Jul 01 07:11:20.405047 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-283295a7-71f6-465a-bc83-4d29b75d6781 req-97dc6d3f-3e92-423e-a174-e4e363f98e5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 Jul 01 07:11:20.406143 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 180/371] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:11:20.830358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f86e870e-0464-4828-810a-dbcbd1d187ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:20.831018 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f86e870e-0464-4828-810a-dbcbd1d187ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:20.833061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:20.839201 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f86e870e-0464-4828-810a-dbcbd1d187ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:20.839689 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f86e870e-0464-4828-810a-dbcbd1d187ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:20.840533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f86e870e-0464-4828-810a-dbcbd1d187ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:20.840969 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f86e870e-0464-4828-810a-dbcbd1d187ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:21.161864 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6333977e-601c-4b61-a572-d7bb77a5837d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:21.162671 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6333977e-601c-4b61-a572-d7bb77a5837d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:21.168890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6333977e-601c-4b61-a572-d7bb77a5837d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:21.169412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6333977e-601c-4b61-a572-d7bb77a5837d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:21.170242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6333977e-601c-4b61-a572-d7bb77a5837d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:21.170742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6333977e-601c-4b61-a572-d7bb77a5837d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:21.193738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f86e870e-0464-4828-810a-dbcbd1d187ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:21.196401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:21.204304 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f86e870e-0464-4828-810a-dbcbd1d187ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.378562 Jul 01 07:11:21.204914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 192/372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:20 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:21.386132 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6333977e-601c-4b61-a572-d7bb77a5837d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:21.394316 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6333977e-601c-4b61-a572-d7bb77a5837d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1505 microversion: 2.1 time: 0.236647 Jul 01 07:11:21.394929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 181/373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:21 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:22.221777 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-638112a1-e6d1-4e22-a9dd-f88aa29b8be1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:22.223073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-638112a1-e6d1-4e22-a9dd-f88aa29b8be1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:22.230339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-638112a1-e6d1-4e22-a9dd-f88aa29b8be1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:22.230898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-638112a1-e6d1-4e22-a9dd-f88aa29b8be1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:22.231672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-638112a1-e6d1-4e22-a9dd-f88aa29b8be1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:22.232103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-638112a1-e6d1-4e22-a9dd-f88aa29b8be1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:22.412129 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-eee43fe3-d5d9-4b5c-a301-2ce15c123d46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:22.412738 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-eee43fe3-d5d9-4b5c-a301-2ce15c123d46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:22.419322 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eee43fe3-d5d9-4b5c-a301-2ce15c123d46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:22.419839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eee43fe3-d5d9-4b5c-a301-2ce15c123d46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:22.420531 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eee43fe3-d5d9-4b5c-a301-2ce15c123d46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:22.420972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eee43fe3-d5d9-4b5c-a301-2ce15c123d46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:22.594106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-638112a1-e6d1-4e22-a9dd-f88aa29b8be1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:22.602500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-638112a1-e6d1-4e22-a9dd-f88aa29b8be1 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.385300 Jul 01 07:11:22.603096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 193/374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:22 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:22.678458 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-eee43fe3-d5d9-4b5c-a301-2ce15c123d46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:22.686276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-eee43fe3-d5d9-4b5c-a301-2ce15c123d46 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1505 microversion: 2.1 time: 0.278577 Jul 01 07:11:22.686850 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 182/375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:22 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:22.943815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-08cc6d67-9c20-4343-b310-bafbced6b28d req-fdfa777f-a4d7-46f1-8e2f-e0bc103301ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8394dc3e-ffc0-4669-a5e3-a0f38609bb1e", "name": "network-vif-deleted", "tag": "55758cc6-4eaa-4ad5-b20b-1ff5911b9866"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:22.952271 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-08cc6d67-9c20-4343-b310-bafbced6b28d req-fdfa777f-a4d7-46f1-8e2f-e0bc103301ef service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:22.952708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-08cc6d67-9c20-4343-b310-bafbced6b28d req-fdfa777f-a4d7-46f1-8e2f-e0bc103301ef service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:22.964998 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-08cc6d67-9c20-4343-b310-bafbced6b28d req-fdfa777f-a4d7-46f1-8e2f-e0bc103301ef service nova] Creating event network-vif-deleted:55758cc6-4eaa-4ad5-b20b-1ff5911b9866 for instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e on hv-cinder-80721 Jul 01 07:11:22.969960 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-08cc6d67-9c20-4343-b310-bafbced6b28d req-fdfa777f-a4d7-46f1-8e2f-e0bc103301ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029987 Jul 01 07:11:22.970825 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 194/376] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:11:23.619353 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ec2d4ae8-43f6-4754-b0e8-cf0d86427c75 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:23.619968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ec2d4ae8-43f6-4754-b0e8-cf0d86427c75 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:23.627200 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ec2d4ae8-43f6-4754-b0e8-cf0d86427c75 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:23.627699 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ec2d4ae8-43f6-4754-b0e8-cf0d86427c75 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:23.628485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ec2d4ae8-43f6-4754-b0e8-cf0d86427c75 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:23.628971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ec2d4ae8-43f6-4754-b0e8-cf0d86427c75 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:23.703851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7d34c128-cc91-4684-bd32-140abc3d1a42 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:23.704547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7d34c128-cc91-4684-bd32-140abc3d1a42 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:23.710700 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7d34c128-cc91-4684-bd32-140abc3d1a42 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:23.711171 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7d34c128-cc91-4684-bd32-140abc3d1a42 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:23.711928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7d34c128-cc91-4684-bd32-140abc3d1a42 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:23.712359 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7d34c128-cc91-4684-bd32-140abc3d1a42 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:23.800450 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7d34c128-cc91-4684-bd32-140abc3d1a42 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:23.807805 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7d34c128-cc91-4684-bd32-140abc3d1a42 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1299 microversion: 2.1 time: 0.108197 Jul 01 07:11:23.809010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 195/377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:23 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:23.891080 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ec2d4ae8-43f6-4754-b0e8-cf0d86427c75 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:23.898485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ec2d4ae8-43f6-4754-b0e8-cf0d86427c75 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1370 microversion: 2.1 time: 0.283016 Jul 01 07:11:23.899082 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 183/378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:23 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:24.500421 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-622263643", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "networks": [{"uuid": "0be3a606-8ed5-49e6-be40-ef0af9b5225b"}]}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:24.549668 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] validate_networks() for [('0be3a606-8ed5-49e6-be40-ef0af9b5225b', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:11:24.825241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:24.825856 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:24.832835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:24.833288 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:24.834062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:24.834505 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:24.865193 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:24.865647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:24.866103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lazy-loading 'fault' on Instance uuid 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:11:24.902689 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:11:24.903226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:11:24.903610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:11:24.904019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:11:24.904724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:11:24.914205 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:24.914579 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:24.915415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:24.915848 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:24.922760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:24.930576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f7f4b877-d649-4f03-92a0-610e178c9981 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 200 len: 1304 microversion: 2.1 time: 0.109162 Jul 01 07:11:24.931155 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 184/379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:24 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:24.933633 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Getting quotas for project 6dd3241e9f134a7bb89bbaf40232959c. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:11:24.935932 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c6e042e0-676a-408e-8ad1-3a527c136adf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:24.936877 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c6e042e0-676a-408e-8ad1-3a527c136adf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:24.938014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Getting quotas for user 1957cb1501da480f9974bda730ce9db3 and project 6dd3241e9f134a7bb89bbaf40232959c. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:11:24.943251 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c6e042e0-676a-408e-8ad1-3a527c136adf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:24.943696 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c6e042e0-676a-408e-8ad1-3a527c136adf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:24.944475 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c6e042e0-676a-408e-8ad1-3a527c136adf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:24.944906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c6e042e0-676a-408e-8ad1-3a527c136adf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:24.949654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:11:24.951953 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:11:24.996598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-af31c703-c855-45b7-baa9-f5c722fadac2 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499986 Jul 01 07:11:24.997242 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 196/380] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:11:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:11:25.007444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b134725e-aa0f-4f2e-a1e0-fcc078153dd3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:25.008334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b134725e-aa0f-4f2e-a1e0-fcc078153dd3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:25.080971 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b134725e-aa0f-4f2e-a1e0-fcc078153dd3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:25.089085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b134725e-aa0f-4f2e-a1e0-fcc078153dd3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1218 microversion: 2.1 time: 0.085309 Jul 01 07:11:25.094632 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 197/381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:25 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:25.108890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c6e042e0-676a-408e-8ad1-3a527c136adf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:25.117029 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c6e042e0-676a-408e-8ad1-3a527c136adf tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1564 microversion: 2.1 time: 0.184756 Jul 01 07:11:25.117587 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 185/382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:24 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:25.134466 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3e4e2f81-1a65-4cc3-9b01-fc3dddfbaaca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:25.135177 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3e4e2f81-1a65-4cc3-9b01-fc3dddfbaaca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:25.143003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3e4e2f81-1a65-4cc3-9b01-fc3dddfbaaca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:25.143523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3e4e2f81-1a65-4cc3-9b01-fc3dddfbaaca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:25.144357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3e4e2f81-1a65-4cc3-9b01-fc3dddfbaaca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:25.144864 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3e4e2f81-1a65-4cc3-9b01-fc3dddfbaaca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:25.239791 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3e4e2f81-1a65-4cc3-9b01-fc3dddfbaaca tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109904 Jul 01 07:11:25.240431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 198/383] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jul 1 07:11:25 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:11:25.948695 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:25.949311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:25.955769 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:25.956224 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:25.957000 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:25.957440 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:25.971337 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] HTTP exception thrown: Instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e could not be found. Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Request method failure captured: Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e HTTP/1.1 Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp3ySH96iy4aJ2AKglJDlZ0Pplr2QpldI1QfvbXB3hNhFZk8RRYeEce8WgEXUqTFUgXMs2rwjFIUGvlVIZX-SF8ZTjZmjnXx8eQzj1zpbZGQ3H_JUs7dUc4AkbRYv2LbMj6v0cmpeXyjGANpbGOEJ4Uxy2IxM5_Q1u-ULGoRz16qGfo Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: 1c5b07c9b6004015bc1e693324d246ce Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-VolumesActionsTest-1054390633 Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:11:25.972968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c5b07c9b6004015bc1e693324d246ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c5b07c9b6004015bc1e693324d246ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1c5b07c9b6004015bc1e693324d246ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1c5b07c9b6004015bc1e693324d246ce"}]}] Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-VolumesActionsTest-1054390633 Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 1c5b07c9b6004015bc1e693324d246ce Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-VolumesActionsTest-1054390633 Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-VolumesActionsTest-1054390633-project Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 6e8e19cb76464144a74a8504bcc42083 Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-VolumesActionsTest-1054390633-project Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e could not be found. Jul 01 07:11:25.974546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '8394dc3e-ffc0-4669-a5e3-a0f38609bb1e'} Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e could not be found. Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:11:25.975350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e could not be found. Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e could not be found. Jul 01 07:11:25.976591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:11:25.977658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Returning 404 to user: Instance 8394dc3e-ffc0-4669-a5e3-a0f38609bb1e could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:11:25.977658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9848b085-9c65-4395-9228-1c4723b0a767 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e" status: 404 len: 111 microversion: 2.1 time: 0.029669 Jul 01 07:11:25.977658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 186/384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:25 2022] GET /compute/v2.1/servers/8394dc3e-ffc0-4669-a5e3-a0f38609bb1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:11:26.075532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1419388807", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "networks": [{"uuid": "276838b3-8831-458c-bc9c-231564b00696"}]}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:26.105276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5fe3bc98-3f20-4a01-b97b-e67e00d977cf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:26.105886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5fe3bc98-3f20-4a01-b97b-e67e00d977cf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:26.112079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc98-3f20-4a01-b97b-e67e00d977cf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:26.112520 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc98-3f20-4a01-b97b-e67e00d977cf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:26.113598 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc98-3f20-4a01-b97b-e67e00d977cf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:26.114029 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc98-3f20-4a01-b97b-e67e00d977cf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:26.130028 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] validate_networks() for [('276838b3-8831-458c-bc9c-231564b00696', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:11:26.199383 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5fe3bc98-3f20-4a01-b97b-e67e00d977cf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:26.212937 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5fe3bc98-3f20-4a01-b97b-e67e00d977cf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1222 microversion: 2.1 time: 0.106122 Jul 01 07:11:26.223275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 187/385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:26 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:26.357142 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-96a56dee-03c9-4bf8-9ded-da658229d67a req-b6b4971c-f00c-4f1a-a5b7-08361670093c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0721e7-9239-4832-b6dc-329e0682e8c6", "tag": "55005d37-c17f-4cd9-ba0e-3e7034d6e963"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:26.365752 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-96a56dee-03c9-4bf8-9ded-da658229d67a req-b6b4971c-f00c-4f1a-a5b7-08361670093c service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:26.366196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-96a56dee-03c9-4bf8-9ded-da658229d67a req-b6b4971c-f00c-4f1a-a5b7-08361670093c service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:26.377975 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-96a56dee-03c9-4bf8-9ded-da658229d67a req-b6b4971c-f00c-4f1a-a5b7-08361670093c service nova] Creating event network-changed:55005d37-c17f-4cd9-ba0e-3e7034d6e963 for instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 on hv-cinder-80721 Jul 01 07:11:26.382963 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-96a56dee-03c9-4bf8-9ded-da658229d67a req-b6b4971c-f00c-4f1a-a5b7-08361670093c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029436 Jul 01 07:11:26.387062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 188/386] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:11:26.511101 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:11:26.511526 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:11:26.512024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:11:26.512433 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:11:26.512845 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:11:26.521636 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:26.522176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:26.523023 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:26.523448 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:26.549770 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Getting quotas for project 1c5b07c9b6004015bc1e693324d246ce. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:11:26.553574 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Getting quotas for user 6e8e19cb76464144a74a8504bcc42083 and project 1c5b07c9b6004015bc1e693324d246ce. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:11:26.565635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:11:26.567806 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:11:26.613796 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ec924ef6-f57c-4d58-8a69-a300a7e63da4 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541946 Jul 01 07:11:26.619578 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 199/387] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:11:26.625078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f67a3797-aab4-459b-8774-3e2a81ae1eb7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:26.625786 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f67a3797-aab4-459b-8774-3e2a81ae1eb7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:26.684841 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f67a3797-aab4-459b-8774-3e2a81ae1eb7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:26.692229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f67a3797-aab4-459b-8774-3e2a81ae1eb7 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1214 microversion: 2.1 time: 0.071407 Jul 01 07:11:26.692824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 189/388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:26 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:27.231601 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-97fc7cac-da2b-4be4-8c0c-0e9f5d59d0fa tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:27.232462 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-97fc7cac-da2b-4be4-8c0c-0e9f5d59d0fa tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:27.239095 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-97fc7cac-da2b-4be4-8c0c-0e9f5d59d0fa tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:27.239548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-97fc7cac-da2b-4be4-8c0c-0e9f5d59d0fa tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:27.240320 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-97fc7cac-da2b-4be4-8c0c-0e9f5d59d0fa tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:27.240747 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-97fc7cac-da2b-4be4-8c0c-0e9f5d59d0fa tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:27.306180 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-97fc7cac-da2b-4be4-8c0c-0e9f5d59d0fa tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:27.314133 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-97fc7cac-da2b-4be4-8c0c-0e9f5d59d0fa tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1222 microversion: 2.1 time: 0.087075 Jul 01 07:11:27.314703 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 200/389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:27 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:27.709697 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-74c1d8fb-71d8-44f5-9cea-5bd263f7246d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:27.710304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-74c1d8fb-71d8-44f5-9cea-5bd263f7246d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:27.717017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-74c1d8fb-71d8-44f5-9cea-5bd263f7246d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:27.717468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-74c1d8fb-71d8-44f5-9cea-5bd263f7246d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:27.718229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-74c1d8fb-71d8-44f5-9cea-5bd263f7246d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:27.718661 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-74c1d8fb-71d8-44f5-9cea-5bd263f7246d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:27.784277 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-74c1d8fb-71d8-44f5-9cea-5bd263f7246d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:27.791816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-74c1d8fb-71d8-44f5-9cea-5bd263f7246d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1218 microversion: 2.1 time: 0.085931 Jul 01 07:11:27.792359 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 190/390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:27 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:28.331435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-02882a2c-4b8b-4e97-883f-3cf53ad447da tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:28.332044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-02882a2c-4b8b-4e97-883f-3cf53ad447da tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:28.338010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-02882a2c-4b8b-4e97-883f-3cf53ad447da tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:28.338463 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-02882a2c-4b8b-4e97-883f-3cf53ad447da tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:28.339244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-02882a2c-4b8b-4e97-883f-3cf53ad447da tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:28.339675 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-02882a2c-4b8b-4e97-883f-3cf53ad447da tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:28.401227 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-02882a2c-4b8b-4e97-883f-3cf53ad447da tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:28.408584 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-02882a2c-4b8b-4e97-883f-3cf53ad447da tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1222 microversion: 2.1 time: 0.081718 Jul 01 07:11:28.409355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 201/391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:28 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:28.807523 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9fd378e9-e05a-40bc-87b9-557ee70db525 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:28.808128 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9fd378e9-e05a-40bc-87b9-557ee70db525 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:28.815613 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9fd378e9-e05a-40bc-87b9-557ee70db525 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:28.816059 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9fd378e9-e05a-40bc-87b9-557ee70db525 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:28.816856 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9fd378e9-e05a-40bc-87b9-557ee70db525 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:28.817284 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9fd378e9-e05a-40bc-87b9-557ee70db525 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:28.876765 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9fd378e9-e05a-40bc-87b9-557ee70db525 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:28.884009 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9fd378e9-e05a-40bc-87b9-557ee70db525 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1218 microversion: 2.1 time: 0.080270 Jul 01 07:11:28.884562 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 191/392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:28 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:29.426120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d5f78e25-154c-4971-9a0f-1fdcc1845c7f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:29.427629 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d5f78e25-154c-4971-9a0f-1fdcc1845c7f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:29.433803 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5f78e25-154c-4971-9a0f-1fdcc1845c7f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:29.434951 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5f78e25-154c-4971-9a0f-1fdcc1845c7f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:29.436840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5f78e25-154c-4971-9a0f-1fdcc1845c7f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:29.437426 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5f78e25-154c-4971-9a0f-1fdcc1845c7f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:29.550437 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d5f78e25-154c-4971-9a0f-1fdcc1845c7f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:29.558196 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d5f78e25-154c-4971-9a0f-1fdcc1845c7f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1214 microversion: 2.1 time: 0.136251 Jul 01 07:11:29.558793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 202/393] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:29 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:29.900894 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b5fe09ac-b8bf-48d8-9019-8b4a501c1595 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:29.901508 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b5fe09ac-b8bf-48d8-9019-8b4a501c1595 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:29.909274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5fe09ac-b8bf-48d8-9019-8b4a501c1595 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:29.909754 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5fe09ac-b8bf-48d8-9019-8b4a501c1595 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:29.910523 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5fe09ac-b8bf-48d8-9019-8b4a501c1595 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:29.911008 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5fe09ac-b8bf-48d8-9019-8b4a501c1595 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:29.915263 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:29.983712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b5fe09ac-b8bf-48d8-9019-8b4a501c1595 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:29.991732 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b5fe09ac-b8bf-48d8-9019-8b4a501c1595 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1210 microversion: 2.1 time: 0.095203 Jul 01 07:11:29.992297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 192/394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:29 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:30.575431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e09b860b-4883-4cde-b766-88d2b3015bb3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:30.576043 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e09b860b-4883-4cde-b766-88d2b3015bb3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:30.582865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e09b860b-4883-4cde-b766-88d2b3015bb3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:30.583308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e09b860b-4883-4cde-b766-88d2b3015bb3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:30.584094 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e09b860b-4883-4cde-b766-88d2b3015bb3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:30.584523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e09b860b-4883-4cde-b766-88d2b3015bb3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:30.651912 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e09b860b-4883-4cde-b766-88d2b3015bb3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:30.659682 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e09b860b-4883-4cde-b766-88d2b3015bb3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1270 microversion: 2.1 time: 0.088035 Jul 01 07:11:30.660327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 203/395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:30 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:30.758091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-384091266", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1681175753", "security_groups": [{"name": "tempest-secgroup-smoke-2103428788"}], "networks": [{"uuid": "38468323-b142-46c6-94a9-e21b929b0c8b"}], "block_device_mapping_v2": [{"uuid": "031498a3-7653-412e-af17-f2b6584a6b94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:30.766612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:30.911090 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] validate_networks() for [('38468323-b142-46c6-94a9-e21b929b0c8b', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:11:31.009342 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b93142c0-014d-4e64-8975-f795296bd918 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:31.009961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b93142c0-014d-4e64-8975-f795296bd918 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:31.016251 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b93142c0-014d-4e64-8975-f795296bd918 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:31.017011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b93142c0-014d-4e64-8975-f795296bd918 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:31.017695 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b93142c0-014d-4e64-8975-f795296bd918 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:31.018350 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b93142c0-014d-4e64-8975-f795296bd918 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:31.095904 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b93142c0-014d-4e64-8975-f795296bd918 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:31.103387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b93142c0-014d-4e64-8975-f795296bd918 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1266 microversion: 2.1 time: 0.097937 Jul 01 07:11:31.104179 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 204/396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:31 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:31.546504 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:11:31.546969 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:11:31.547445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:11:31.547852 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:11:31.548264 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:11:31.556926 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:31.557376 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:31.558170 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:31.558600 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:31.575792 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Getting quotas for project d8def43018744d7b8d5a5f422e44bf89. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:11:31.579723 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Getting quotas for user 0a36e02c916b494180e68d3f231ee714 and project d8def43018744d7b8d5a5f422e44bf89. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:11:31.642073 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:11:31.644830 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='031498a3-7653-412e-af17-f2b6584a6b94',volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:11:31.676713 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8947aa6d-6578-4dee-b9b8-5f77080521d8 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:31.678138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8947aa6d-6578-4dee-b9b8-5f77080521d8 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:31.684711 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8947aa6d-6578-4dee-b9b8-5f77080521d8 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:31.685233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8947aa6d-6578-4dee-b9b8-5f77080521d8 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:31.686258 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8947aa6d-6578-4dee-b9b8-5f77080521d8 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:31.686639 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8947aa6d-6578-4dee-b9b8-5f77080521d8 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:31.784384 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-efcbe841-890e-4595-9f29-123afcd5a2ad tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.030085 Jul 01 07:11:31.786852 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 193/397] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:11:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:11:31.795436 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-074b4d89-c046-4733-9e36-ee3a3848560e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:31.796265 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-074b4d89-c046-4733-9e36-ee3a3848560e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:32.074638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8947aa6d-6578-4dee-b9b8-5f77080521d8 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:32.086598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8947aa6d-6578-4dee-b9b8-5f77080521d8 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1276 microversion: 2.1 time: 0.414215 Jul 01 07:11:32.096110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 205/398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:31 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1276 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:32.101954 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-074b4d89-c046-4733-9e36-ee3a3848560e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:32.110203 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-074b4d89-c046-4733-9e36-ee3a3848560e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1088 microversion: 2.1 time: 0.318895 Jul 01 07:11:32.110914 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 194/399] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:31 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1088 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:32.125110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b39242e1-6e81-4bf1-a31a-9538e7d0f244 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:32.127031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b39242e1-6e81-4bf1-a31a-9538e7d0f244 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:32.134826 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b39242e1-6e81-4bf1-a31a-9538e7d0f244 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:32.135520 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b39242e1-6e81-4bf1-a31a-9538e7d0f244 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:32.136373 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b39242e1-6e81-4bf1-a31a-9538e7d0f244 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:32.136977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b39242e1-6e81-4bf1-a31a-9538e7d0f244 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:32.250199 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b39242e1-6e81-4bf1-a31a-9538e7d0f244 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:32.260154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b39242e1-6e81-4bf1-a31a-9538e7d0f244 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1272 microversion: 2.1 time: 0.142972 Jul 01 07:11:32.262815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 206/400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:32 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:33.104707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d9bbc823-0a72-4588-88a4-c26192979387 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:33.105524 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d9bbc823-0a72-4588-88a4-c26192979387 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:33.111774 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d9bbc823-0a72-4588-88a4-c26192979387 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:33.112293 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d9bbc823-0a72-4588-88a4-c26192979387 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:33.113119 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d9bbc823-0a72-4588-88a4-c26192979387 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:33.113617 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d9bbc823-0a72-4588-88a4-c26192979387 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:33.126801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4dbc08f9-0bc2-4c6b-b920-cd2fe64a89ab tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:33.128025 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4dbc08f9-0bc2-4c6b-b920-cd2fe64a89ab tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:33.134217 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4dbc08f9-0bc2-4c6b-b920-cd2fe64a89ab tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:33.134661 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4dbc08f9-0bc2-4c6b-b920-cd2fe64a89ab tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:33.135464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4dbc08f9-0bc2-4c6b-b920-cd2fe64a89ab tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:33.135892 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4dbc08f9-0bc2-4c6b-b920-cd2fe64a89ab tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:33.277780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4dbc08f9-0bc2-4c6b-b920-cd2fe64a89ab tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:33.298407 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4dbc08f9-0bc2-4c6b-b920-cd2fe64a89ab tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1204 microversion: 2.1 time: 0.175292 Jul 01 07:11:33.300149 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 207/401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:33 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1204 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:33.304737 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-358eaee5-02ce-49bf-b923-b3b8686cbcdb tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:33.306413 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-358eaee5-02ce-49bf-b923-b3b8686cbcdb tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:33.313031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-358eaee5-02ce-49bf-b923-b3b8686cbcdb tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:33.313674 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-358eaee5-02ce-49bf-b923-b3b8686cbcdb tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:33.314592 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-358eaee5-02ce-49bf-b923-b3b8686cbcdb tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:33.315245 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-358eaee5-02ce-49bf-b923-b3b8686cbcdb tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:33.665603 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d9bbc823-0a72-4588-88a4-c26192979387 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:33.675388 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d9bbc823-0a72-4588-88a4-c26192979387 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.574706 Jul 01 07:11:33.676648 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 195/402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:33 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:33.814539 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-358eaee5-02ce-49bf-b923-b3b8686cbcdb tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:33.828044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-358eaee5-02ce-49bf-b923-b3b8686cbcdb tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.526731 Jul 01 07:11:33.828866 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 208/403] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:33 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:34.318034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-272afc6e-6e88-45c0-a272-af16a48dafed tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:34.318957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-272afc6e-6e88-45c0-a272-af16a48dafed tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:34.327962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-272afc6e-6e88-45c0-a272-af16a48dafed tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:34.328416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-272afc6e-6e88-45c0-a272-af16a48dafed tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:34.329381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-272afc6e-6e88-45c0-a272-af16a48dafed tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:34.329973 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-272afc6e-6e88-45c0-a272-af16a48dafed tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:34.425591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-272afc6e-6e88-45c0-a272-af16a48dafed tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:34.434465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-272afc6e-6e88-45c0-a272-af16a48dafed tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1192 microversion: 2.1 time: 0.121848 Jul 01 07:11:34.435576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 196/404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:34 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1192 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:34.695127 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a956a196-4981-436b-b676-c97d44bee1f5 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:34.696349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a956a196-4981-436b-b676-c97d44bee1f5 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:34.704398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a956a196-4981-436b-b676-c97d44bee1f5 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:34.705009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a956a196-4981-436b-b676-c97d44bee1f5 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:34.705897 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a956a196-4981-436b-b676-c97d44bee1f5 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:34.707050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a956a196-4981-436b-b676-c97d44bee1f5 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:34.846945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6af1d5fc-974f-4412-86ad-637bd7645a6d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:34.848844 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6af1d5fc-974f-4412-86ad-637bd7645a6d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:34.855310 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6af1d5fc-974f-4412-86ad-637bd7645a6d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:34.856277 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6af1d5fc-974f-4412-86ad-637bd7645a6d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:34.857440 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6af1d5fc-974f-4412-86ad-637bd7645a6d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:34.857885 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6af1d5fc-974f-4412-86ad-637bd7645a6d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:35.197785 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a956a196-4981-436b-b676-c97d44bee1f5 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:35.212508 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a956a196-4981-436b-b676-c97d44bee1f5 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.518411 Jul 01 07:11:35.224024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 209/405] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:34 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:35.228929 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-dea77262-1986-4f98-afcd-a4def6db72d3 req-fa5bbf8f-0df9-4a19-b5f5-d8b5daa2b983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8656e950-5648-4618-8903-c7a23f9f5c46", "tag": "6a129c25-2d7b-4f7c-a0bc-1a8297081bea"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:35.238446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-dea77262-1986-4f98-afcd-a4def6db72d3 req-fa5bbf8f-0df9-4a19-b5f5-d8b5daa2b983 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:35.239009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-dea77262-1986-4f98-afcd-a4def6db72d3 req-fa5bbf8f-0df9-4a19-b5f5-d8b5daa2b983 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:35.255334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-dea77262-1986-4f98-afcd-a4def6db72d3 req-fa5bbf8f-0df9-4a19-b5f5-d8b5daa2b983 service nova] Creating event network-changed:6a129c25-2d7b-4f7c-a0bc-1a8297081bea for instance 8656e950-5648-4618-8903-c7a23f9f5c46 on hv-cinder-80721 Jul 01 07:11:35.260634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-dea77262-1986-4f98-afcd-a4def6db72d3 req-fa5bbf8f-0df9-4a19-b5f5-d8b5daa2b983 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035238 Jul 01 07:11:35.261218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 210/406] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:11:35.300830 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6af1d5fc-974f-4412-86ad-637bd7645a6d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:35.310325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6af1d5fc-974f-4412-86ad-637bd7645a6d tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.468296 Jul 01 07:11:35.311278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 197/407] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:34 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:35.457783 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0f9158c9-c4eb-4770-8551-92031314d675 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:35.458485 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0f9158c9-c4eb-4770-8551-92031314d675 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:35.469902 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f9158c9-c4eb-4770-8551-92031314d675 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:35.470362 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f9158c9-c4eb-4770-8551-92031314d675 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:35.472458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f9158c9-c4eb-4770-8551-92031314d675 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:35.473293 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f9158c9-c4eb-4770-8551-92031314d675 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:35.923936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0f9158c9-c4eb-4770-8551-92031314d675 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:35.932507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0f9158c9-c4eb-4770-8551-92031314d675 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.484800 Jul 01 07:11:35.933419 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 211/408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:35 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:36.229344 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2dcfac86-c311-49cc-a21c-59a6b0721001 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:36.229947 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2dcfac86-c311-49cc-a21c-59a6b0721001 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:36.237887 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2dcfac86-c311-49cc-a21c-59a6b0721001 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:36.238330 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2dcfac86-c311-49cc-a21c-59a6b0721001 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:36.239449 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2dcfac86-c311-49cc-a21c-59a6b0721001 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:36.239877 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2dcfac86-c311-49cc-a21c-59a6b0721001 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:36.328030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-dc64b5c2-b670-4a1a-9ae3-7a106607bafa tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:36.328642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-dc64b5c2-b670-4a1a-9ae3-7a106607bafa tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:36.335210 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc64b5c2-b670-4a1a-9ae3-7a106607bafa tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:36.335588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc64b5c2-b670-4a1a-9ae3-7a106607bafa tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:36.336394 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc64b5c2-b670-4a1a-9ae3-7a106607bafa tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:36.337878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc64b5c2-b670-4a1a-9ae3-7a106607bafa tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:36.511194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2dcfac86-c311-49cc-a21c-59a6b0721001 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:36.519793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2dcfac86-c311-49cc-a21c-59a6b0721001 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.293975 Jul 01 07:11:36.520585 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 198/409] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:36 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:36.531714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=4 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:36.560366 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=14 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:36.566701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dc64b5c2-b670-4a1a-9ae3-7a106607bafa tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:36.575396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-dc64b5c2-b670-4a1a-9ae3-7a106607bafa tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.251661 Jul 01 07:11:36.585870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 212/410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:36 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:36.953688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b5c89ac5-7e3f-40cf-8052-a633d47d7ce6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:36.954835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b5c89ac5-7e3f-40cf-8052-a633d47d7ce6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:36.966063 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5c89ac5-7e3f-40cf-8052-a633d47d7ce6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:36.967426 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5c89ac5-7e3f-40cf-8052-a633d47d7ce6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:36.968224 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5c89ac5-7e3f-40cf-8052-a633d47d7ce6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:36.968680 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5c89ac5-7e3f-40cf-8052-a633d47d7ce6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:37.160055 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b5c89ac5-7e3f-40cf-8052-a633d47d7ce6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:37.168091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b5c89ac5-7e3f-40cf-8052-a633d47d7ce6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.218479 Jul 01 07:11:37.168753 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 199/411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:36 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:37.290262 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-acaa9aa2-1781-4b03-ae5f-5efe952760dd req-4155042a-ef04-4b4f-9243-459bcfbb4673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d903ab-e2ab-42ad-be96-41f39fb4ae1f", "tag": "b754cbaa-21c6-4e04-9e11-faf8048b1e61"}, {"name": "network-changed", "server_uuid": "456ae774-27ea-4a7a-a785-7b0f83ffa4b7", "tag": "6cada016-8f00-4c9f-903c-e0d5b5b84f89"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:37.299102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-acaa9aa2-1781-4b03-ae5f-5efe952760dd req-4155042a-ef04-4b4f-9243-459bcfbb4673 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:37.299551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-acaa9aa2-1781-4b03-ae5f-5efe952760dd req-4155042a-ef04-4b4f-9243-459bcfbb4673 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:37.311839 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-acaa9aa2-1781-4b03-ae5f-5efe952760dd req-4155042a-ef04-4b4f-9243-459bcfbb4673 service nova] Creating event network-changed:b754cbaa-21c6-4e04-9e11-faf8048b1e61 for instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f on hv-cinder-80721 Jul 01 07:11:37.312342 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-acaa9aa2-1781-4b03-ae5f-5efe952760dd req-4155042a-ef04-4b4f-9243-459bcfbb4673 service nova] Creating event network-changed:6cada016-8f00-4c9f-903c-e0d5b5b84f89 for instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 on hv-cinder-80721 Jul 01 07:11:37.318960 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-acaa9aa2-1781-4b03-ae5f-5efe952760dd req-4155042a-ef04-4b4f-9243-459bcfbb4673 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032207 Jul 01 07:11:37.319530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 213/412] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:11:37.537046 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ecce6115-3335-4057-b64e-345f49cb9378 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:37.537661 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ecce6115-3335-4057-b64e-345f49cb9378 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:37.544076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ecce6115-3335-4057-b64e-345f49cb9378 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:37.544524 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ecce6115-3335-4057-b64e-345f49cb9378 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:37.545290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ecce6115-3335-4057-b64e-345f49cb9378 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:37.545789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ecce6115-3335-4057-b64e-345f49cb9378 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:37.592800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-51a4a1ba-cc4f-4f89-b0bb-e76a92b6aa24 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:37.593600 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-51a4a1ba-cc4f-4f89-b0bb-e76a92b6aa24 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:37.603466 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-51a4a1ba-cc4f-4f89-b0bb-e76a92b6aa24 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:37.605623 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-51a4a1ba-cc4f-4f89-b0bb-e76a92b6aa24 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:37.606418 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-51a4a1ba-cc4f-4f89-b0bb-e76a92b6aa24 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:37.607050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-51a4a1ba-cc4f-4f89-b0bb-e76a92b6aa24 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:37.611435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:37.726124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ecce6115-3335-4057-b64e-345f49cb9378 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:37.747890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ecce6115-3335-4057-b64e-345f49cb9378 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.214684 Jul 01 07:11:37.753944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 200/413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:37 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:37.792729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-51a4a1ba-cc4f-4f89-b0bb-e76a92b6aa24 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:37.806430 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-51a4a1ba-cc4f-4f89-b0bb-e76a92b6aa24 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.217400 Jul 01 07:11:37.818750 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 214/414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:37 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:38.184884 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0875ef52-3e04-40d2-be9a-e3b787e380cf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:38.185486 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0875ef52-3e04-40d2-be9a-e3b787e380cf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:38.191903 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0875ef52-3e04-40d2-be9a-e3b787e380cf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:38.192350 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0875ef52-3e04-40d2-be9a-e3b787e380cf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:38.193112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0875ef52-3e04-40d2-be9a-e3b787e380cf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:38.193543 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0875ef52-3e04-40d2-be9a-e3b787e380cf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:38.325321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0875ef52-3e04-40d2-be9a-e3b787e380cf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:38.333968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0875ef52-3e04-40d2-be9a-e3b787e380cf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.153048 Jul 01 07:11:38.334970 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 201/415] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:38 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:38.770074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c4ba73bb-5536-4b95-b1ad-9d92b1ddf699 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:38.770681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c4ba73bb-5536-4b95-b1ad-9d92b1ddf699 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:38.776590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4ba73bb-5536-4b95-b1ad-9d92b1ddf699 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:38.777027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4ba73bb-5536-4b95-b1ad-9d92b1ddf699 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:38.777787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4ba73bb-5536-4b95-b1ad-9d92b1ddf699 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:38.778219 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4ba73bb-5536-4b95-b1ad-9d92b1ddf699 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:38.825169 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-80d35371-a4bc-493c-a773-c7f44a5826c6 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:38.825832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-80d35371-a4bc-493c-a773-c7f44a5826c6 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:38.833681 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-80d35371-a4bc-493c-a773-c7f44a5826c6 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:38.834139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-80d35371-a4bc-493c-a773-c7f44a5826c6 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:38.834943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-80d35371-a4bc-493c-a773-c7f44a5826c6 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:38.835382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-80d35371-a4bc-493c-a773-c7f44a5826c6 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:38.957067 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c4ba73bb-5536-4b95-b1ad-9d92b1ddf699 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:38.966846 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c4ba73bb-5536-4b95-b1ad-9d92b1ddf699 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.201020 Jul 01 07:11:38.967483 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 215/416] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:38 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:39.022326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-80d35371-a4bc-493c-a773-c7f44a5826c6 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:39.029726 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-80d35371-a4bc-493c-a773-c7f44a5826c6 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.208341 Jul 01 07:11:39.030280 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 202/417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:38 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:39.351718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e1529bcb-55f8-41f2-a72e-9909b89f6c0a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:39.352509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e1529bcb-55f8-41f2-a72e-9909b89f6c0a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:39.358565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1529bcb-55f8-41f2-a72e-9909b89f6c0a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:39.359040 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1529bcb-55f8-41f2-a72e-9909b89f6c0a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:39.359805 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1529bcb-55f8-41f2-a72e-9909b89f6c0a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:39.360240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1529bcb-55f8-41f2-a72e-9909b89f6c0a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:39.493660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e1529bcb-55f8-41f2-a72e-9909b89f6c0a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:39.500957 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e1529bcb-55f8-41f2-a72e-9909b89f6c0a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.153235 Jul 01 07:11:39.501859 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 216/418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:39 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:39.984051 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d3225aff-2ffb-4ee3-b621-76d88bdb56db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:39.984654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d3225aff-2ffb-4ee3-b621-76d88bdb56db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:39.991627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d3225aff-2ffb-4ee3-b621-76d88bdb56db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:39.992078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d3225aff-2ffb-4ee3-b621-76d88bdb56db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:39.992835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d3225aff-2ffb-4ee3-b621-76d88bdb56db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:39.993271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d3225aff-2ffb-4ee3-b621-76d88bdb56db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:40.047090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0f178650-8f17-4f77-82d3-214dbd157884 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:40.047800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0f178650-8f17-4f77-82d3-214dbd157884 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:40.054879 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f178650-8f17-4f77-82d3-214dbd157884 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:40.055568 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f178650-8f17-4f77-82d3-214dbd157884 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:40.056346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f178650-8f17-4f77-82d3-214dbd157884 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:40.056789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f178650-8f17-4f77-82d3-214dbd157884 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:40.161055 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d3225aff-2ffb-4ee3-b621-76d88bdb56db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:40.169035 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d3225aff-2ffb-4ee3-b621-76d88bdb56db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.188784 Jul 01 07:11:40.169592 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 203/419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:39 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:40.227606 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0f178650-8f17-4f77-82d3-214dbd157884 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:40.235420 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0f178650-8f17-4f77-82d3-214dbd157884 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.192723 Jul 01 07:11:40.235982 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 217/420] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:40 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:40.519261 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9f76ca04-ad6d-49c0-86a6-386c111bc1d7 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:40.519906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9f76ca04-ad6d-49c0-86a6-386c111bc1d7 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:40.525789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9f76ca04-ad6d-49c0-86a6-386c111bc1d7 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:40.526435 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9f76ca04-ad6d-49c0-86a6-386c111bc1d7 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:40.527232 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9f76ca04-ad6d-49c0-86a6-386c111bc1d7 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:40.527855 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9f76ca04-ad6d-49c0-86a6-386c111bc1d7 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:40.662667 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9f76ca04-ad6d-49c0-86a6-386c111bc1d7 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:40.670383 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9f76ca04-ad6d-49c0-86a6-386c111bc1d7 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.156067 Jul 01 07:11:40.670991 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 204/421] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:40 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:41.186946 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-66002a60-3516-4409-91d5-e7a0acc6d57a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:41.187384 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-66002a60-3516-4409-91d5-e7a0acc6d57a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:41.193297 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66002a60-3516-4409-91d5-e7a0acc6d57a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:41.193753 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66002a60-3516-4409-91d5-e7a0acc6d57a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:41.194682 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66002a60-3516-4409-91d5-e7a0acc6d57a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:41.195147 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-66002a60-3516-4409-91d5-e7a0acc6d57a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:41.252337 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-27a49d5b-1334-4ea8-9864-62f913698c79 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:41.253050 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-27a49d5b-1334-4ea8-9864-62f913698c79 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:41.260638 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-27a49d5b-1334-4ea8-9864-62f913698c79 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:41.261105 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-27a49d5b-1334-4ea8-9864-62f913698c79 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:41.261889 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-27a49d5b-1334-4ea8-9864-62f913698c79 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:41.262325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-27a49d5b-1334-4ea8-9864-62f913698c79 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:41.377444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-66002a60-3516-4409-91d5-e7a0acc6d57a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:41.385990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-66002a60-3516-4409-91d5-e7a0acc6d57a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.203711 Jul 01 07:11:41.386335 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 218/422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:41 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:41.425711 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-27a49d5b-1334-4ea8-9864-62f913698c79 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:41.435282 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-27a49d5b-1334-4ea8-9864-62f913698c79 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.186865 Jul 01 07:11:41.435860 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 205/423] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:41 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:41.689363 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ca5a39df-b93c-4a9f-8053-626558115f92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:41.690589 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ca5a39df-b93c-4a9f-8053-626558115f92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:41.697157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ca5a39df-b93c-4a9f-8053-626558115f92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:41.697794 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ca5a39df-b93c-4a9f-8053-626558115f92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:41.698724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ca5a39df-b93c-4a9f-8053-626558115f92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:41.699325 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ca5a39df-b93c-4a9f-8053-626558115f92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:42.305965 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ca5a39df-b93c-4a9f-8053-626558115f92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:42.316949 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ca5a39df-b93c-4a9f-8053-626558115f92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.630891 Jul 01 07:11:42.318077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 219/424] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:41 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:42.402222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-25a42f31-0871-46e6-95c4-3acd9f8062c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:42.402988 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-25a42f31-0871-46e6-95c4-3acd9f8062c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:42.404862 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:42.405621 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=10 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:42.413213 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-25a42f31-0871-46e6-95c4-3acd9f8062c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:42.413666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-25a42f31-0871-46e6-95c4-3acd9f8062c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:42.414441 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-25a42f31-0871-46e6-95c4-3acd9f8062c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:42.414936 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-25a42f31-0871-46e6-95c4-3acd9f8062c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:42.452770 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f9a145d8-d2a6-4f65-9bb2-a61786e2461a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:42.453005 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f9a145d8-d2a6-4f65-9bb2-a61786e2461a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:42.461247 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9a145d8-d2a6-4f65-9bb2-a61786e2461a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:42.461939 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9a145d8-d2a6-4f65-9bb2-a61786e2461a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:42.462898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9a145d8-d2a6-4f65-9bb2-a61786e2461a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:42.463364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f9a145d8-d2a6-4f65-9bb2-a61786e2461a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:42.914279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-25a42f31-0871-46e6-95c4-3acd9f8062c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:42.916595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f9a145d8-d2a6-4f65-9bb2-a61786e2461a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:42.923555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-25a42f31-0871-46e6-95c4-3acd9f8062c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.525257 Jul 01 07:11:42.925224 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 206/425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:42 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:42.926207 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f9a145d8-d2a6-4f65-9bb2-a61786e2461a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.477653 Jul 01 07:11:42.935720 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 220/426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:42 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:43.221524 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-83066dbb-5d50-4c1d-93d7-64dafb210285 req-c15ab74e-bba9-447a-be87-88fcb52460c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d903ab-e2ab-42ad-be96-41f39fb4ae1f", "name": "network-vif-plugged", "status": "completed", "tag": "b754cbaa-21c6-4e04-9e11-faf8048b1e61"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:43.229701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-83066dbb-5d50-4c1d-93d7-64dafb210285 req-c15ab74e-bba9-447a-be87-88fcb52460c3 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:43.230138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-83066dbb-5d50-4c1d-93d7-64dafb210285 req-c15ab74e-bba9-447a-be87-88fcb52460c3 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:43.241575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-83066dbb-5d50-4c1d-93d7-64dafb210285 req-c15ab74e-bba9-447a-be87-88fcb52460c3 service nova] Creating event network-vif-plugged:b754cbaa-21c6-4e04-9e11-faf8048b1e61 for instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f on hv-cinder-80721 Jul 01 07:11:43.246575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-83066dbb-5d50-4c1d-93d7-64dafb210285 req-c15ab74e-bba9-447a-be87-88fcb52460c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029282 Jul 01 07:11:43.247248 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 207/427] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:11:43.333624 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-06385753-8715-46b9-881c-40c4ef5f7754 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:43.334178 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-06385753-8715-46b9-881c-40c4ef5f7754 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:43.340343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-06385753-8715-46b9-881c-40c4ef5f7754 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:43.340794 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-06385753-8715-46b9-881c-40c4ef5f7754 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:43.341583 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-06385753-8715-46b9-881c-40c4ef5f7754 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:43.342015 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-06385753-8715-46b9-881c-40c4ef5f7754 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:43.472901 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-06385753-8715-46b9-881c-40c4ef5f7754 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:43.480324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-06385753-8715-46b9-881c-40c4ef5f7754 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.150659 Jul 01 07:11:43.480880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 221/428] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:43 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:43.941703 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8dd14ef3-2005-454e-a3dd-94a5ed6ad96a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:43.942177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8dd14ef3-2005-454e-a3dd-94a5ed6ad96a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:43.943905 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-32169446-d54c-42a0-b18f-9b2f7ab20bed tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:43.944593 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-32169446-d54c-42a0-b18f-9b2f7ab20bed tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:43.948971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8dd14ef3-2005-454e-a3dd-94a5ed6ad96a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:43.949416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8dd14ef3-2005-454e-a3dd-94a5ed6ad96a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:43.950358 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8dd14ef3-2005-454e-a3dd-94a5ed6ad96a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:43.950817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8dd14ef3-2005-454e-a3dd-94a5ed6ad96a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:43.950945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-32169446-d54c-42a0-b18f-9b2f7ab20bed tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:43.951565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-32169446-d54c-42a0-b18f-9b2f7ab20bed tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:43.952461 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-32169446-d54c-42a0-b18f-9b2f7ab20bed tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:43.953128 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-32169446-d54c-42a0-b18f-9b2f7ab20bed tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:44.159775 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8dd14ef3-2005-454e-a3dd-94a5ed6ad96a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:44.164470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-32169446-d54c-42a0-b18f-9b2f7ab20bed tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:44.168235 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8dd14ef3-2005-454e-a3dd-94a5ed6ad96a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.231885 Jul 01 07:11:44.169150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 208/429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:43 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:44.173512 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-32169446-d54c-42a0-b18f-9b2f7ab20bed tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.234031 Jul 01 07:11:44.174254 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 222/430] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:43 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:44.497589 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-556bf62d-e619-4009-919a-8c9f138bc8b0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:44.498204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-556bf62d-e619-4009-919a-8c9f138bc8b0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:44.504913 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-556bf62d-e619-4009-919a-8c9f138bc8b0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:44.505597 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-556bf62d-e619-4009-919a-8c9f138bc8b0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:44.506377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-556bf62d-e619-4009-919a-8c9f138bc8b0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:44.506838 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-556bf62d-e619-4009-919a-8c9f138bc8b0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:44.778014 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-556bf62d-e619-4009-919a-8c9f138bc8b0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:44.785471 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-556bf62d-e619-4009-919a-8c9f138bc8b0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.291797 Jul 01 07:11:44.786034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 209/431] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:44 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:45.185235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8155ddac-5479-4d20-b4e1-1775e7371a87 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:45.185861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8155ddac-5479-4d20-b4e1-1775e7371a87 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:45.192442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4a3b635a-1ba6-4888-8b5a-c6aa6eccd6b9 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:45.192937 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8155ddac-5479-4d20-b4e1-1775e7371a87 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:45.193167 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8155ddac-5479-4d20-b4e1-1775e7371a87 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:45.193848 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8155ddac-5479-4d20-b4e1-1775e7371a87 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:45.194290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8155ddac-5479-4d20-b4e1-1775e7371a87 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:45.194616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4a3b635a-1ba6-4888-8b5a-c6aa6eccd6b9 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:45.201137 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4a3b635a-1ba6-4888-8b5a-c6aa6eccd6b9 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:45.201705 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4a3b635a-1ba6-4888-8b5a-c6aa6eccd6b9 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:45.202574 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4a3b635a-1ba6-4888-8b5a-c6aa6eccd6b9 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:45.203193 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4a3b635a-1ba6-4888-8b5a-c6aa6eccd6b9 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:45.436912 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8155ddac-5479-4d20-b4e1-1775e7371a87 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:45.439702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4a3b635a-1ba6-4888-8b5a-c6aa6eccd6b9 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:45.447621 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4a3b635a-1ba6-4888-8b5a-c6aa6eccd6b9 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.260439 Jul 01 07:11:45.448110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8155ddac-5479-4d20-b4e1-1775e7371a87 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.266527 Jul 01 07:11:45.449109 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 223/432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:45 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:45.457082 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 210/433] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:45 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:45.734672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-c7b2f4ea-c039-469f-a64d-a03589f433b1 req-85b2e4ee-ad0e-4827-9c2f-46ccac9cf7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8656e950-5648-4618-8903-c7a23f9f5c46", "name": "network-vif-plugged", "status": "completed", "tag": "6a129c25-2d7b-4f7c-a0bc-1a8297081bea"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:45.744500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-c7b2f4ea-c039-469f-a64d-a03589f433b1 req-85b2e4ee-ad0e-4827-9c2f-46ccac9cf7aa service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:45.745006 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-c7b2f4ea-c039-469f-a64d-a03589f433b1 req-85b2e4ee-ad0e-4827-9c2f-46ccac9cf7aa service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:45.772530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-c7b2f4ea-c039-469f-a64d-a03589f433b1 req-85b2e4ee-ad0e-4827-9c2f-46ccac9cf7aa service nova] Creating event network-vif-plugged:6a129c25-2d7b-4f7c-a0bc-1a8297081bea for instance 8656e950-5648-4618-8903-c7a23f9f5c46 on hv-cinder-80721 Jul 01 07:11:45.777570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-c7b2f4ea-c039-469f-a64d-a03589f433b1 req-85b2e4ee-ad0e-4827-9c2f-46ccac9cf7aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046503 Jul 01 07:11:45.778334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 224/434] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:11:45.801555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7a777f8b-5a85-4278-8b4d-d682e40eb518 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:45.802256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7a777f8b-5a85-4278-8b4d-d682e40eb518 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:45.809095 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7a777f8b-5a85-4278-8b4d-d682e40eb518 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:45.809884 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7a777f8b-5a85-4278-8b4d-d682e40eb518 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:45.810664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7a777f8b-5a85-4278-8b4d-d682e40eb518 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:45.811131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7a777f8b-5a85-4278-8b4d-d682e40eb518 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:45.819433 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:45.980882 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7a777f8b-5a85-4278-8b4d-d682e40eb518 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:45.989485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7a777f8b-5a85-4278-8b4d-d682e40eb518 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.191938 Jul 01 07:11:45.990164 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 211/435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:45 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:46.464921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d1dba4f0-cb65-4a22-9bb7-fbc0500a0375 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:46.465532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ea27caf7-5b02-4fab-a90c-e5fbe65cc14b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:46.465919 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d1dba4f0-cb65-4a22-9bb7-fbc0500a0375 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:46.466029 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ea27caf7-5b02-4fab-a90c-e5fbe65cc14b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:46.472326 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ea27caf7-5b02-4fab-a90c-e5fbe65cc14b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:46.472973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ea27caf7-5b02-4fab-a90c-e5fbe65cc14b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:46.473427 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d1dba4f0-cb65-4a22-9bb7-fbc0500a0375 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:46.473739 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ea27caf7-5b02-4fab-a90c-e5fbe65cc14b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:46.473886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d1dba4f0-cb65-4a22-9bb7-fbc0500a0375 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:46.474201 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ea27caf7-5b02-4fab-a90c-e5fbe65cc14b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:46.475179 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d1dba4f0-cb65-4a22-9bb7-fbc0500a0375 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:46.476329 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d1dba4f0-cb65-4a22-9bb7-fbc0500a0375 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:46.688739 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d1dba4f0-cb65-4a22-9bb7-fbc0500a0375 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:46.691750 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ea27caf7-5b02-4fab-a90c-e5fbe65cc14b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:46.699267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d1dba4f0-cb65-4a22-9bb7-fbc0500a0375 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.237970 Jul 01 07:11:46.700376 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 212/436] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:46 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:46.709987 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ea27caf7-5b02-4fab-a90c-e5fbe65cc14b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1314 microversion: 2.1 time: 0.239521 Jul 01 07:11:46.710645 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 225/437] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:46 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:47.007006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-17b275f2-d859-4c05-aeeb-8aa8f9e9704c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:47.007517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-17b275f2-d859-4c05-aeeb-8aa8f9e9704c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:47.015211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17b275f2-d859-4c05-aeeb-8aa8f9e9704c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:47.015661 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17b275f2-d859-4c05-aeeb-8aa8f9e9704c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:47.016536 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17b275f2-d859-4c05-aeeb-8aa8f9e9704c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:47.016907 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17b275f2-d859-4c05-aeeb-8aa8f9e9704c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:47.169835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-17b275f2-d859-4c05-aeeb-8aa8f9e9704c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:47.178047 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-17b275f2-d859-4c05-aeeb-8aa8f9e9704c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.175051 Jul 01 07:11:47.178609 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 213/438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:47 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:47.716617 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c662347f-e380-4e50-aa55-f9919268c9c6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:47.717246 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c662347f-e380-4e50-aa55-f9919268c9c6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:47.723662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c662347f-e380-4e50-aa55-f9919268c9c6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:47.724094 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c662347f-e380-4e50-aa55-f9919268c9c6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:47.724835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c662347f-e380-4e50-aa55-f9919268c9c6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:47.725436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c662347f-e380-4e50-aa55-f9919268c9c6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:47.727031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6a805b2d-2ddf-4daa-a2ae-e059aa6b693a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:47.727796 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6a805b2d-2ddf-4daa-a2ae-e059aa6b693a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:47.734110 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6a805b2d-2ddf-4daa-a2ae-e059aa6b693a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:47.734560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6a805b2d-2ddf-4daa-a2ae-e059aa6b693a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:47.735463 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6a805b2d-2ddf-4daa-a2ae-e059aa6b693a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:47.735931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6a805b2d-2ddf-4daa-a2ae-e059aa6b693a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:48.144536 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c662347f-e380-4e50-aa55-f9919268c9c6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:48.148686 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6a805b2d-2ddf-4daa-a2ae-e059aa6b693a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:48.152530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c662347f-e380-4e50-aa55-f9919268c9c6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1318 microversion: 2.1 time: 0.439079 Jul 01 07:11:48.158816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 226/439] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:47 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:48.158981 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6a805b2d-2ddf-4daa-a2ae-e059aa6b693a tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1499 microversion: 2.1 time: 0.434024 Jul 01 07:11:48.158981 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 214/440] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:47 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1499 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:48.194923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-34c5bb86-ab3b-4e63-894f-56f3adcb5ce5 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:48.195358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-34c5bb86-ab3b-4e63-894f-56f3adcb5ce5 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:48.202057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:48.204330 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-34c5bb86-ab3b-4e63-894f-56f3adcb5ce5 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:48.204868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-34c5bb86-ab3b-4e63-894f-56f3adcb5ce5 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:48.207057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-34c5bb86-ab3b-4e63-894f-56f3adcb5ce5 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:48.207456 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-34c5bb86-ab3b-4e63-894f-56f3adcb5ce5 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:48.358904 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-34c5bb86-ab3b-4e63-894f-56f3adcb5ce5 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:48.371495 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-34c5bb86-ab3b-4e63-894f-56f3adcb5ce5 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.180416 Jul 01 07:11:48.372064 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 227/441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:48 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:48.987656 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2d2c02fc-1cea-4bc1-afe2-1ff88d3c2da2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:48.989619 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2d2c02fc-1cea-4bc1-afe2-1ff88d3c2da2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:48.995299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2d2c02fc-1cea-4bc1-afe2-1ff88d3c2da2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:48.995781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2d2c02fc-1cea-4bc1-afe2-1ff88d3c2da2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:48.998449 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2d2c02fc-1cea-4bc1-afe2-1ff88d3c2da2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:48.998449 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2d2c02fc-1cea-4bc1-afe2-1ff88d3c2da2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:49.022895 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2d2c02fc-1cea-4bc1-afe2-1ff88d3c2da2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:11:49.099491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2d2c02fc-1cea-4bc1-afe2-1ff88d3c2da2 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "DELETE /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 204 len: 0 microversion: 2.1 time: 0.116843 Jul 01 07:11:49.100303 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 215/442] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:11:48 2022] DELETE /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:11:49.109559 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4eb1d0db-d015-4873-ad4d-d82a632629ca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:49.110635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4eb1d0db-d015-4873-ad4d-d82a632629ca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:49.117176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4eb1d0db-d015-4873-ad4d-d82a632629ca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:49.117613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4eb1d0db-d015-4873-ad4d-d82a632629ca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:49.118635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4eb1d0db-d015-4873-ad4d-d82a632629ca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:49.119129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4eb1d0db-d015-4873-ad4d-d82a632629ca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:49.170184 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d8278db0-fc19-4c2a-a01f-4c25cb84393d tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:49.171029 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d8278db0-fc19-4c2a-a01f-4c25cb84393d tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:49.177859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d8278db0-fc19-4c2a-a01f-4c25cb84393d tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:49.178505 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d8278db0-fc19-4c2a-a01f-4c25cb84393d tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:49.179575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d8278db0-fc19-4c2a-a01f-4c25cb84393d tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:49.180213 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d8278db0-fc19-4c2a-a01f-4c25cb84393d tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:49.319009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4eb1d0db-d015-4873-ad4d-d82a632629ca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:49.326482 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4eb1d0db-d015-4873-ad4d-d82a632629ca tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1505 microversion: 2.1 time: 0.221864 Jul 01 07:11:49.327074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 228/443] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:49 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:49.355882 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d8278db0-fc19-4c2a-a01f-4c25cb84393d tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:49.364075 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d8278db0-fc19-4c2a-a01f-4c25cb84393d tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1507 microversion: 2.1 time: 0.198243 Jul 01 07:11:49.364641 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 216/444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:49 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:11:49.388119 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-68e45caf-3345-4661-8982-44640f3b56ec tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:49.388723 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-68e45caf-3345-4661-8982-44640f3b56ec tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:49.394622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-68e45caf-3345-4661-8982-44640f3b56ec tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:49.395095 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-68e45caf-3345-4661-8982-44640f3b56ec tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:49.395851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-68e45caf-3345-4661-8982-44640f3b56ec tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:49.396280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-68e45caf-3345-4661-8982-44640f3b56ec tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:49.534482 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-68e45caf-3345-4661-8982-44640f3b56ec tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:49.542189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-68e45caf-3345-4661-8982-44640f3b56ec tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.157803 Jul 01 07:11:49.542871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 229/445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:49 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:50.343989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d4308067-c305-4707-9e74-d16495c84e92 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:50.344615 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d4308067-c305-4707-9e74-d16495c84e92 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:50.351418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4308067-c305-4707-9e74-d16495c84e92 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:50.351874 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4308067-c305-4707-9e74-d16495c84e92 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:50.352697 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4308067-c305-4707-9e74-d16495c84e92 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:50.353133 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4308067-c305-4707-9e74-d16495c84e92 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:50.489224 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d4308067-c305-4707-9e74-d16495c84e92 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:50.496807 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d4308067-c305-4707-9e74-d16495c84e92 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1505 microversion: 2.1 time: 0.156812 Jul 01 07:11:50.497368 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 217/446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:50 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:50.559815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-87ca0245-9fab-4047-8b91-c79d05253087 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:50.560458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-87ca0245-9fab-4047-8b91-c79d05253087 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:50.567188 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-87ca0245-9fab-4047-8b91-c79d05253087 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:50.567634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-87ca0245-9fab-4047-8b91-c79d05253087 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:50.568392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-87ca0245-9fab-4047-8b91-c79d05253087 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:50.568823 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-87ca0245-9fab-4047-8b91-c79d05253087 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:50.700644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-87ca0245-9fab-4047-8b91-c79d05253087 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:50.708216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-87ca0245-9fab-4047-8b91-c79d05253087 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.152430 Jul 01 07:11:50.708712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 230/447] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:50 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:51.513645 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-41b05a5f-3cac-4cfa-a254-1f047a68963c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:51.514198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-41b05a5f-3cac-4cfa-a254-1f047a68963c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:51.522030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41b05a5f-3cac-4cfa-a254-1f047a68963c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:51.522526 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41b05a5f-3cac-4cfa-a254-1f047a68963c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:51.523399 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41b05a5f-3cac-4cfa-a254-1f047a68963c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:51.523962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41b05a5f-3cac-4cfa-a254-1f047a68963c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:51.657456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-41b05a5f-3cac-4cfa-a254-1f047a68963c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:51.664788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-41b05a5f-3cac-4cfa-a254-1f047a68963c tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1505 microversion: 2.1 time: 0.155272 Jul 01 07:11:51.665337 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 218/448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:51 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:51.724235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-37a165e3-6db7-4827-9220-61e2d8210f16 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:51.724881 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-37a165e3-6db7-4827-9220-61e2d8210f16 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:51.731024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-37a165e3-6db7-4827-9220-61e2d8210f16 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:51.731476 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-37a165e3-6db7-4827-9220-61e2d8210f16 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:51.732234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-37a165e3-6db7-4827-9220-61e2d8210f16 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:51.732662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-37a165e3-6db7-4827-9220-61e2d8210f16 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:51.748538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:11:51.871091 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-37a165e3-6db7-4827-9220-61e2d8210f16 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:51.879083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-37a165e3-6db7-4827-9220-61e2d8210f16 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.158598 Jul 01 07:11:51.879644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 231/449] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:51 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:52.013543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:11:52.013771 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:11:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:11:52.681822 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e0d8433b-4c66-40b2-a55b-fe6ba9af8381 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:52.682430 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e0d8433b-4c66-40b2-a55b-fe6ba9af8381 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:52.689204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e0d8433b-4c66-40b2-a55b-fe6ba9af8381 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:52.689655 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e0d8433b-4c66-40b2-a55b-fe6ba9af8381 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:52.691006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e0d8433b-4c66-40b2-a55b-fe6ba9af8381 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:52.691445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e0d8433b-4c66-40b2-a55b-fe6ba9af8381 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:52.900784 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3c94b61a-087c-4833-b60f-bdbc614657f6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:52.901376 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e0d8433b-4c66-40b2-a55b-fe6ba9af8381 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8e19cb76464144a74a8504bcc42083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5b07c9b6004015bc1e693324d246ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:52.901808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3c94b61a-087c-4833-b60f-bdbc614657f6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:52.918276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e0d8433b-4c66-40b2-a55b-fe6ba9af8381 tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 200 len: 1505 microversion: 2.1 time: 0.240032 Jul 01 07:11:52.931157 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 219/450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:52 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:52.931396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3c94b61a-087c-4833-b60f-bdbc614657f6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:52.931396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3c94b61a-087c-4833-b60f-bdbc614657f6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:52.931396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3c94b61a-087c-4833-b60f-bdbc614657f6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:52.931396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3c94b61a-087c-4833-b60f-bdbc614657f6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:53.161236 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-36962300-4c01-4eb1-bd2c-f9b28b07e00d req-edab3b2c-329e-4951-9a5c-4b84a471fa38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d903ab-e2ab-42ad-be96-41f39fb4ae1f", "name": "network-vif-deleted", "tag": "b754cbaa-21c6-4e04-9e11-faf8048b1e61"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:53.165565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3c94b61a-087c-4833-b60f-bdbc614657f6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:53.170642 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-36962300-4c01-4eb1-bd2c-f9b28b07e00d req-edab3b2c-329e-4951-9a5c-4b84a471fa38 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:53.171310 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-36962300-4c01-4eb1-bd2c-f9b28b07e00d req-edab3b2c-329e-4951-9a5c-4b84a471fa38 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:53.174504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3c94b61a-087c-4833-b60f-bdbc614657f6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.281203 Jul 01 07:11:53.175694 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 232/451] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:52 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:53.187611 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-36962300-4c01-4eb1-bd2c-f9b28b07e00d req-edab3b2c-329e-4951-9a5c-4b84a471fa38 service nova] Creating event network-vif-deleted:b754cbaa-21c6-4e04-9e11-faf8048b1e61 for instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f on hv-cinder-80721 Jul 01 07:11:53.194113 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-36962300-4c01-4eb1-bd2c-f9b28b07e00d req-edab3b2c-329e-4951-9a5c-4b84a471fa38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038287 Jul 01 07:11:53.194701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 220/452] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:11:53.939182 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:53.939815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] [instance: 79d903ab-e2ab-42ad-be96-41f39fb4ae1f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:53.946394 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:53.946757 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:53.947617 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:53.948041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:53.961780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] HTTP exception thrown: Instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f could not be found. Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Request method failure captured: Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f HTTP/1.1 Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp3ySH96iy4aJ2AKglJDlZ0Pplr2QpldI1QfvbXB3hNhFZk8RRYeEce8WgEXUqTFUgXMs2rwjFIUGvlVIZX-SF8ZTjZmjnXx8eQzj1zpbZGQ3H_JUs7dUc4AkbRYv2LbMj6v0cmpeXyjGANpbGOEJ4Uxy2IxM5_Q1u-ULGoRz16qGfo Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: 1c5b07c9b6004015bc1e693324d246ce Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-VolumesActionsTest-1054390633 Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:11:53.963435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c5b07c9b6004015bc1e693324d246ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c5b07c9b6004015bc1e693324d246ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1c5b07c9b6004015bc1e693324d246ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1c5b07c9b6004015bc1e693324d246ce"}]}] Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-VolumesActionsTest-1054390633 Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: 1c5b07c9b6004015bc1e693324d246ce Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-VolumesActionsTest-1054390633 Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-VolumesActionsTest-1054390633-project Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 6e8e19cb76464144a74a8504bcc42083 Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-VolumesActionsTest-1054390633-project Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f could not be found. Jul 01 07:11:53.965235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '79d903ab-e2ab-42ad-be96-41f39fb4ae1f'} Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f could not be found. Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:11:53.966120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f could not be found. Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f could not be found. Jul 01 07:11:53.967555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:11:53.968660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] Returning 404 to user: Instance 79d903ab-e2ab-42ad-be96-41f39fb4ae1f could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:11:53.968660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c7a4510b-60cb-4a09-914b-76eb0110584b tempest-VolumesActionsTest-1054390633 tempest-VolumesActionsTest-1054390633-project] 10.222.0.48 "GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f" status: 404 len: 111 microversion: 2.1 time: 0.029481 Jul 01 07:11:53.968660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 233/453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:53 2022] GET /compute/v2.1/servers/79d903ab-e2ab-42ad-be96-41f39fb4ae1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:11:54.196023 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d9f558e7-ac55-4e58-b449-094e3e738387 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:54.196768 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d9f558e7-ac55-4e58-b449-094e3e738387 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:54.203383 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d9f558e7-ac55-4e58-b449-094e3e738387 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:54.203829 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d9f558e7-ac55-4e58-b449-094e3e738387 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:54.204595 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d9f558e7-ac55-4e58-b449-094e3e738387 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:54.205021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d9f558e7-ac55-4e58-b449-094e3e738387 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:54.351357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d9f558e7-ac55-4e58-b449-094e3e738387 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:54.371709 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d9f558e7-ac55-4e58-b449-094e3e738387 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.182638 Jul 01 07:11:54.386944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 221/454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:54 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:55.391454 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-25af1a58-ca6e-42d4-9aae-47be92bb1898 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:55.392102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-25af1a58-ca6e-42d4-9aae-47be92bb1898 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:55.399393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25af1a58-ca6e-42d4-9aae-47be92bb1898 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:55.399844 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25af1a58-ca6e-42d4-9aae-47be92bb1898 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:55.400625 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25af1a58-ca6e-42d4-9aae-47be92bb1898 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:55.401063 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25af1a58-ca6e-42d4-9aae-47be92bb1898 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:55.531716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-25af1a58-ca6e-42d4-9aae-47be92bb1898 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:55.539080 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-25af1a58-ca6e-42d4-9aae-47be92bb1898 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.151759 Jul 01 07:11:55.539637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 234/455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:55 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:55.968040 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-d84617d4-42a1-464e-9e12-4ac53cf0a464 req-a87cda9c-337c-4764-a98a-0cc4c15b67a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456ae774-27ea-4a7a-a785-7b0f83ffa4b7", "name": "network-vif-plugged", "status": "completed", "tag": "6cada016-8f00-4c9f-903c-e0d5b5b84f89"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:11:55.976893 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-d84617d4-42a1-464e-9e12-4ac53cf0a464 req-a87cda9c-337c-4764-a98a-0cc4c15b67a0 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:55.977203 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-d84617d4-42a1-464e-9e12-4ac53cf0a464 req-a87cda9c-337c-4764-a98a-0cc4c15b67a0 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:55.988845 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-d84617d4-42a1-464e-9e12-4ac53cf0a464 req-a87cda9c-337c-4764-a98a-0cc4c15b67a0 service nova] Creating event network-vif-plugged:6cada016-8f00-4c9f-903c-e0d5b5b84f89 for instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 on hv-cinder-80721 Jul 01 07:11:55.993530 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-d84617d4-42a1-464e-9e12-4ac53cf0a464 req-a87cda9c-337c-4764-a98a-0cc4c15b67a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029080 Jul 01 07:11:55.994101 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 222/456] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:11:56.556478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d51dfc09-f9c3-4467-b601-7ea2bffe813e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:56.557099 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d51dfc09-f9c3-4467-b601-7ea2bffe813e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:56.563516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d51dfc09-f9c3-4467-b601-7ea2bffe813e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:56.563967 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d51dfc09-f9c3-4467-b601-7ea2bffe813e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:56.564733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d51dfc09-f9c3-4467-b601-7ea2bffe813e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:56.565219 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d51dfc09-f9c3-4467-b601-7ea2bffe813e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:56.694833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d51dfc09-f9c3-4467-b601-7ea2bffe813e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:56.702183 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d51dfc09-f9c3-4467-b601-7ea2bffe813e tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.149598 Jul 01 07:11:56.702737 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 235/457] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:56 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:57.720424 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-890cce02-aee7-4255-b63a-edbeb3a44939 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:57.721119 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-890cce02-aee7-4255-b63a-edbeb3a44939 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:57.728705 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-890cce02-aee7-4255-b63a-edbeb3a44939 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:57.729278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-890cce02-aee7-4255-b63a-edbeb3a44939 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:57.730166 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-890cce02-aee7-4255-b63a-edbeb3a44939 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:57.730599 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-890cce02-aee7-4255-b63a-edbeb3a44939 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:57.874605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-890cce02-aee7-4255-b63a-edbeb3a44939 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:57.882676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-890cce02-aee7-4255-b63a-edbeb3a44939 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.166966 Jul 01 07:11:57.883255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 223/458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:57 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:11:58.900285 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-28e1e584-3a04-43d3-983e-a12a6e2b0d53 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:11:58.900976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-28e1e584-3a04-43d3-983e-a12a6e2b0d53 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:11:58.907069 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-28e1e584-3a04-43d3-983e-a12a6e2b0d53 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:58.907511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-28e1e584-3a04-43d3-983e-a12a6e2b0d53 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:58.908262 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-28e1e584-3a04-43d3-983e-a12a6e2b0d53 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:11:58.908688 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-28e1e584-3a04-43d3-983e-a12a6e2b0d53 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:11:59.048752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-28e1e584-3a04-43d3-983e-a12a6e2b0d53 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:11:59.056734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-28e1e584-3a04-43d3-983e-a12a6e2b0d53 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1260 microversion: 2.1 time: 0.160257 Jul 01 07:11:59.057300 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 236/459] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:11:58 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:00.075235 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-de19ed37-3619-4e6a-8b24-b57c211d5f58 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:00.075844 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-de19ed37-3619-4e6a-8b24-b57c211d5f58 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:00.082320 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-de19ed37-3619-4e6a-8b24-b57c211d5f58 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:00.082779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-de19ed37-3619-4e6a-8b24-b57c211d5f58 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:00.083607 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-de19ed37-3619-4e6a-8b24-b57c211d5f58 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:00.084040 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-de19ed37-3619-4e6a-8b24-b57c211d5f58 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:00.213829 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-de19ed37-3619-4e6a-8b24-b57c211d5f58 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:00.221327 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-de19ed37-3619-4e6a-8b24-b57c211d5f58 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1444 microversion: 2.1 time: 0.149969 Jul 01 07:12:00.222189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 224/460] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:00 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:00.304235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-36aee40f-c7f0-4283-afdf-e43affdc8cb0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:00.304865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-36aee40f-c7f0-4283-afdf-e43affdc8cb0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:00.311510 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-36aee40f-c7f0-4283-afdf-e43affdc8cb0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:00.311961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-36aee40f-c7f0-4283-afdf-e43affdc8cb0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:00.312747 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-36aee40f-c7f0-4283-afdf-e43affdc8cb0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:00.313215 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-36aee40f-c7f0-4283-afdf-e43affdc8cb0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:00.456031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-36aee40f-c7f0-4283-afdf-e43affdc8cb0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:00.463528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-36aee40f-c7f0-4283-afdf-e43affdc8cb0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1444 microversion: 2.1 time: 0.163804 Jul 01 07:12:00.464092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 237/461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:00 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:02.543133 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-4f7e85bf-46e4-4cd8-8c07-405ffb462ded req-31048516-1fc7-487e-86a5-593bf2b31dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "456ae774-27ea-4a7a-a785-7b0f83ffa4b7", "tag": "6cada016-8f00-4c9f-903c-e0d5b5b84f89"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:02.547652 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:02.554462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-4f7e85bf-46e4-4cd8-8c07-405ffb462ded req-31048516-1fc7-487e-86a5-593bf2b31dc7 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:02.555015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-4f7e85bf-46e4-4cd8-8c07-405ffb462ded req-31048516-1fc7-487e-86a5-593bf2b31dc7 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:02.567301 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-4f7e85bf-46e4-4cd8-8c07-405ffb462ded req-31048516-1fc7-487e-86a5-593bf2b31dc7 service nova] Creating event network-changed:6cada016-8f00-4c9f-903c-e0d5b5b84f89 for instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 on hv-cinder-80721 Jul 01 07:12:02.573100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-4f7e85bf-46e4-4cd8-8c07-405ffb462ded req-31048516-1fc7-487e-86a5-593bf2b31dc7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033905 Jul 01 07:12:02.573825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 225/462] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:12:06.494226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-07f4007a-d3f4-4ffb-9262-c2c77d6834ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:06.494737 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-07f4007a-d3f4-4ffb-9262-c2c77d6834ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:06.500747 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-07f4007a-d3f4-4ffb-9262-c2c77d6834ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:06.501199 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-07f4007a-d3f4-4ffb-9262-c2c77d6834ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:06.501964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-07f4007a-d3f4-4ffb-9262-c2c77d6834ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:06.502401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-07f4007a-d3f4-4ffb-9262-c2c77d6834ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:06.526195 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-07f4007a-d3f4-4ffb-9262-c2c77d6834ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/ips" status: 200 len: 150 microversion: 2.1 time: 0.035928 Jul 01 07:12:06.526754 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 238/463] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:12:06 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:12:12.041572 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-09809db2-9d87-4803-a7b9-9dd0690de3e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:12.042189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-09809db2-9d87-4803-a7b9-9dd0690de3e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:12.048623 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-09809db2-9d87-4803-a7b9-9dd0690de3e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:12.049071 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-09809db2-9d87-4803-a7b9-9dd0690de3e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:12.049835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-09809db2-9d87-4803-a7b9-9dd0690de3e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:12.050271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-09809db2-9d87-4803-a7b9-9dd0690de3e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:12.073744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-09809db2-9d87-4803-a7b9-9dd0690de3e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/ips" status: 200 len: 152 microversion: 2.20 time: 0.037215 Jul 01 07:12:12.074296 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 226/464] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jul 1 07:12:12 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:12:17.111533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8167a997-1d44-4056-be28-6bf78614a730 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:17.112145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8167a997-1d44-4056-be28-6bf78614a730 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:17.114220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=23 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:17.115018 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=39 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:17.122312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8167a997-1d44-4056-be28-6bf78614a730 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:17.122977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8167a997-1d44-4056-be28-6bf78614a730 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:17.123754 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8167a997-1d44-4056-be28-6bf78614a730 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:17.124192 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8167a997-1d44-4056-be28-6bf78614a730 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:17.148563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-8167a997-1d44-4056-be28-6bf78614a730 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lazy-loading 'flavor' on Instance uuid 06e3db32-ed35-4c27-ad2f-30bfbe556c25 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:12:17.291581 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4cccd5c2-2e67-4b08-858c-c59ee38d8146 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:17.292645 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4cccd5c2-2e67-4b08-858c-c59ee38d8146 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:17.299356 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cccd5c2-2e67-4b08-858c-c59ee38d8146 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:17.299806 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cccd5c2-2e67-4b08-858c-c59ee38d8146 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:17.300594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cccd5c2-2e67-4b08-858c-c59ee38d8146 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:17.301055 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4cccd5c2-2e67-4b08-858c-c59ee38d8146 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:17.303597 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:17.445170 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8167a997-1d44-4056-be28-6bf78614a730 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/action" status: 202 len: 0 microversion: 2.20 time: 0.337270 Jul 01 07:12:17.445812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 239/465] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jul 1 07:12:17 2022] POST /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:12:17.454009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:17.455329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:17.461501 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:17.461903 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:17.462684 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:17.463162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:17.635497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:17.645691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:17.648245 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:17.649718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-40475e3c-7cbb-49a2-8bfa-d44e8199cc59 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.199470 Jul 01 07:12:17.650425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 240/466] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:17 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:12:17.677167 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4cccd5c2-2e67-4b08-858c-c59ee38d8146 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389963 Jul 01 07:12:17.677814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 227/467] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:12:17 2022] POST /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:12:18.669350 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:18.670009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:18.676074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:18.676523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:18.677289 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:18.678371 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:18.813752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:18.822436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:18.823975 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:18.825116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e42f98c3-15fb-4898-bb95-7ec586cd13f3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.159683 Jul 01 07:12:18.825664 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 241/468] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:18 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:19.844024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:19.844723 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:19.851062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:19.851539 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:19.852302 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:19.852836 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:19.990850 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:19.998866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:20.000372 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:20.001529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-97c7f42e-c72b-4f8a-a4e6-e1de07c33be4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.162189 Jul 01 07:12:20.002069 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 228/469] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:19 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:21.025801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:21.027330 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:21.036058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:21.038095 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:21.039924 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:21.040560 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:21.184398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:21.193003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:21.195877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:21.197161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-991ecec5-e358-4497-a46e-64d60467d3b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.180756 Jul 01 07:12:21.197987 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 242/470] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:21 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:22.215933 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:22.217957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:22.226079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:22.226832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:22.227982 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:22.228633 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:22.371620 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:22.381254 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:22.383545 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:22.384936 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-36f494bf-fc5b-40f6-b720-6aecc49bc443 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.173068 Jul 01 07:12:22.385961 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 229/471] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:22 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:23.405465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:23.406737 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:23.413908 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:23.414467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:23.415387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:23.416088 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:23.569036 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:23.578079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:23.579619 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:23.580968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-515e191b-4bd1-45f8-a95d-8f2f6504283a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.180175 Jul 01 07:12:23.581550 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 243/472] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:23 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:24.600636 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:24.601228 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:24.608387 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:24.608827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:24.609784 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:24.610418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:24.780881 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:24.791039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:24.792934 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:24.794177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-73458baa-f721-40c6-a03d-459c9c09f0c7 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.198285 Jul 01 07:12:24.794967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 230/473] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:24 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:25.813244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:25.815576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:25.822643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:25.823204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:25.824079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:25.824583 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:25.987849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:25.998215 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:25.999950 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:26.001280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-82ba97a1-6813-4f19-828f-6f0319c4bc8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.192631 Jul 01 07:12:26.001951 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 244/474] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:25 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:27.020190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:27.022008 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:27.028887 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:27.029564 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:27.030410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:27.030934 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:27.178247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:27.187259 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:27.193730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:27.193730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fbda0b58-0971-4399-9a74-3183ec6c8e10 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.174031 Jul 01 07:12:27.201290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 231/475] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:27 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:28.211108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:28.212852 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:28.221865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:28.222313 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:28.223575 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:28.223575 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:28.401357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:28.419375 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:28.420807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:28.421974 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5d2af1f9-f1f5-49bf-8e8c-11abca448099 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.216794 Jul 01 07:12:28.430111 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 245/476] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:28 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:28.478129 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ab79ca02-d818-465b-bbe6-937c09b1495e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: .version_select at 0x7f2c4a555430>, body: {"keypair": {"name": "tempest-keypair-122527863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEA8/C7PWmgt4QVqYPM65AMZyimw1e4I24jwZrmsOUCnRINh9YQIDJgY6zHCtASCwyVlVxnvEpoAXvKn+9oewZwugo+SVzS6KwXC50MGA0eYB777xdxR/d83LyQshsgrng=="}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:28.493724 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-ab79ca02-d818-465b-bbe6-937c09b1495e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for project dc0aa7206a704d45a610dccc24ec8767. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:12:28.497876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-ab79ca02-d818-465b-bbe6-937c09b1495e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for user df44f27783d34370ad83470ffde558a8 and project dc0aa7206a704d45a610dccc24ec8767. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:12:28.522277 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ab79ca02-d818-465b-bbe6-937c09b1495e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048849 Jul 01 07:12:28.522869 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 232/477] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:12:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:12:29.451100 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:29.452001 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:29.460052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:29.463336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:29.464315 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:29.469199 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:29.720667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:29.731807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:29.738184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:29.739789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9cc0f3d3-dc60-442b-a90d-fcfd1471845e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.292861 Jul 01 07:12:29.740880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 246/478] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:29 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:30.193552 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-457503217", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f720862-6697-4120-b152-2a0712a988e8"}], "security_groups": [{"name": "tempest-securitygroup--370303144"}], "key_name": "tempest-keypair-122527863", "user_data": "}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:30.307715 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] validate_networks() for [('2f720862-6697-4120-b152-2a0712a988e8', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:12:30.760033 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:30.760679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:30.765043 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:12:30.765587 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:12:30.766181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:12:30.766674 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:30.766825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:12:30.767153 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:30.767442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:12:30.767911 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:30.768344 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:30.776882 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:30.777454 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:30.778366 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:30.778937 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:30.799735 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for project dc0aa7206a704d45a610dccc24ec8767. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:12:30.804832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for user df44f27783d34370ad83470ffde558a8 and project dc0aa7206a704d45a610dccc24ec8767. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:12:30.817596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:12:30.820904 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:12:30.892641 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a3b8b2cb-ad12-4e3c-9b24-ba907237d80c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.703969 Jul 01 07:12:30.899840 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 233/479] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:12:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:12:30.910657 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f156efa9-b456-4d8c-879d-23022c029178 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:30.911515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f156efa9-b456-4d8c-879d-23022c029178 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:30.998415 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f156efa9-b456-4d8c-879d-23022c029178 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:31.006668 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f156efa9-b456-4d8c-879d-23022c029178 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1240 microversion: 2.1 time: 0.101196 Jul 01 07:12:31.017356 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 234/480] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:30 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:31.027768 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:31.037406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:31.038961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:31.040150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5adbf797-3303-4ae7-a0b1-9daaeb5ae4a4 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.284688 Jul 01 07:12:31.040801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 247/481] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:30 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:32.031381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-098a923d-47e6-4258-9503-f865b5971e88 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:32.032022 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-098a923d-47e6-4258-9503-f865b5971e88 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:32.039407 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-098a923d-47e6-4258-9503-f865b5971e88 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:32.039868 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-098a923d-47e6-4258-9503-f865b5971e88 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:32.040860 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-098a923d-47e6-4258-9503-f865b5971e88 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:32.041454 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-098a923d-47e6-4258-9503-f865b5971e88 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:32.058032 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:32.059777 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:32.071828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:32.072285 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:32.073130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:32.073567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:32.149872 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-098a923d-47e6-4258-9503-f865b5971e88 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:32.158395 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-098a923d-47e6-4258-9503-f865b5971e88 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1292 microversion: 2.1 time: 0.136028 Jul 01 07:12:32.159152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 235/482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:32 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1292 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:32.275899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:32.284270 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:32.285784 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:32.287738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-eba26d8a-8169-4cfc-acbf-5a342d128237 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.233451 Jul 01 07:12:32.288292 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 248/483] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:32 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:33.178499 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a06d66d9-bbaf-4f23-9988-e3bcd39043c4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:33.179140 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a06d66d9-bbaf-4f23-9988-e3bcd39043c4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:33.197249 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a06d66d9-bbaf-4f23-9988-e3bcd39043c4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:33.197915 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a06d66d9-bbaf-4f23-9988-e3bcd39043c4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:33.198863 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a06d66d9-bbaf-4f23-9988-e3bcd39043c4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:33.199335 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a06d66d9-bbaf-4f23-9988-e3bcd39043c4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:33.305447 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:33.306186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:33.318671 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a06d66d9-bbaf-4f23-9988-e3bcd39043c4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:33.326454 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:33.327387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:33.328498 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:33.329083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:33.329713 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a06d66d9-bbaf-4f23-9988-e3bcd39043c4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1298 microversion: 2.1 time: 0.154544 Jul 01 07:12:33.344696 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 236/484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:33 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:33.556171 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:33.580816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:33.584845 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:33.587372 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-792a7f45-ac68-42f1-969f-04f6d1cfd177 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.285251 Jul 01 07:12:33.596628 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 249/485] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:33 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:34.351117 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8b89fbd6-eb1e-4bea-ac7c-e7592dc253e3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:34.352045 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8b89fbd6-eb1e-4bea-ac7c-e7592dc253e3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:34.358959 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8b89fbd6-eb1e-4bea-ac7c-e7592dc253e3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:34.359756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8b89fbd6-eb1e-4bea-ac7c-e7592dc253e3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:34.360774 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8b89fbd6-eb1e-4bea-ac7c-e7592dc253e3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:34.361422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8b89fbd6-eb1e-4bea-ac7c-e7592dc253e3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:34.621247 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:34.621861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:34.628742 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:34.629311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:34.631136 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:34.631672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:34.662230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8b89fbd6-eb1e-4bea-ac7c-e7592dc253e3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:34.677445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8b89fbd6-eb1e-4bea-ac7c-e7592dc253e3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.331319 Jul 01 07:12:34.678244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 237/486] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:34 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:34.847153 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:34.856783 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:34.858391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:34.859582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-924f8ba5-ab6d-49c1-bf7b-3fcb8c7b0e21 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.249464 Jul 01 07:12:34.860284 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 250/487] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:34 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:34.909053 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-8b140a77-adf9-4bf7-b148-1dc14a74664e req-b8d81c53-ce10-46bd-8eb3-d9335d4a8736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d723a853-e49d-405c-9a21-8ce304f65da8", "tag": "342eab1d-fb07-4376-b0e3-5225ba34bca8"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:34.920576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-8b140a77-adf9-4bf7-b148-1dc14a74664e req-b8d81c53-ce10-46bd-8eb3-d9335d4a8736 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:34.921025 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-8b140a77-adf9-4bf7-b148-1dc14a74664e req-b8d81c53-ce10-46bd-8eb3-d9335d4a8736 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:34.941002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-8b140a77-adf9-4bf7-b148-1dc14a74664e req-b8d81c53-ce10-46bd-8eb3-d9335d4a8736 service nova] Creating event network-changed:342eab1d-fb07-4376-b0e3-5225ba34bca8 for instance d723a853-e49d-405c-9a21-8ce304f65da8 on hv-cinder-80721 Jul 01 07:12:34.946266 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-8b140a77-adf9-4bf7-b148-1dc14a74664e req-b8d81c53-ce10-46bd-8eb3-d9335d4a8736 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041103 Jul 01 07:12:34.946956 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 238/488] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:12:35.695659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-31729cb0-73ce-4a2d-8fde-259f9a5c27a1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:35.696298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-31729cb0-73ce-4a2d-8fde-259f9a5c27a1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:35.702666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-31729cb0-73ce-4a2d-8fde-259f9a5c27a1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:35.703141 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-31729cb0-73ce-4a2d-8fde-259f9a5c27a1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:35.703904 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-31729cb0-73ce-4a2d-8fde-259f9a5c27a1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:35.704333 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-31729cb0-73ce-4a2d-8fde-259f9a5c27a1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:35.840678 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-31729cb0-73ce-4a2d-8fde-259f9a5c27a1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:35.848353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-31729cb0-73ce-4a2d-8fde-259f9a5c27a1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.157146 Jul 01 07:12:35.850283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 251/489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:35 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:35.878079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:35.878794 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:35.885576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:35.886093 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:35.886976 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:35.887512 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:36.028211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:36.040609 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:36.042276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:36.043484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c27396cc-b55c-4035-9dcd-ccf51fe0f2be tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.170020 Jul 01 07:12:36.055091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 239/490] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:35 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:36.378161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-96437c8c-31a5-4f48-853f-92b6d6c77f0c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a447bb2-2304-463c-b243-dbe5e6c78e91", "device": "/dev/sdb"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:36.380637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-96437c8c-31a5-4f48-853f-92b6d6c77f0c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:36.388028 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-96437c8c-31a5-4f48-853f-92b6d6c77f0c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:36.388898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-96437c8c-31a5-4f48-853f-92b6d6c77f0c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:36.389842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-96437c8c-31a5-4f48-853f-92b6d6c77f0c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:36.390434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-96437c8c-31a5-4f48-853f-92b6d6c77f0c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:36.865334 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f68228f0-bebf-4f6e-b359-159014c86e9b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:36.865829 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f68228f0-bebf-4f6e-b359-159014c86e9b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:36.871983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f68228f0-bebf-4f6e-b359-159014c86e9b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:36.872434 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f68228f0-bebf-4f6e-b359-159014c86e9b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:36.873190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f68228f0-bebf-4f6e-b359-159014c86e9b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:36.873622 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f68228f0-bebf-4f6e-b359-159014c86e9b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:37.004789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f68228f0-bebf-4f6e-b359-159014c86e9b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:37.012887 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f68228f0-bebf-4f6e-b359-159014c86e9b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.151526 Jul 01 07:12:37.013435 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 240/491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:36 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:12:37.062759 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:37.063386 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:37.069857 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:37.070307 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:37.071094 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:37.071530 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:37.209064 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:37.217003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:37.218510 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:37.219731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fa1b00c0-03d3-42c7-bf11-2f168b0055dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.161192 Jul 01 07:12:37.220291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 241/492] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:37 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:12:38.033563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e6d5092b-7132-4d0f-826d-ae05aeea85b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:38.035563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e6d5092b-7132-4d0f-826d-ae05aeea85b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:38.056195 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e6d5092b-7132-4d0f-826d-ae05aeea85b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:38.058545 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e6d5092b-7132-4d0f-826d-ae05aeea85b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:38.061497 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e6d5092b-7132-4d0f-826d-ae05aeea85b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:38.062152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e6d5092b-7132-4d0f-826d-ae05aeea85b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:38.279052 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e6d5092b-7132-4d0f-826d-ae05aeea85b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:38.289987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e6d5092b-7132-4d0f-826d-ae05aeea85b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.264239 Jul 01 07:12:38.290455 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 242/493] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:38 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:12:38.304508 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:38.305365 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:38.312448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:38.313092 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:38.314033 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:38.314629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:38.636067 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:38.647228 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:38.670030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:38.671560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6eadded2-39bd-44f9-a958-7c11a3298bc9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.374024 Jul 01 07:12:38.672132 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 243/494] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:38 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:38.765223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:38.824748 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-96437c8c-31a5-4f48-853f-92b6d6c77f0c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "POST /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.450409 Jul 01 07:12:38.830868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 252/495] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:12:36 2022] POST /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46/os-volume_attachments => generated 194 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:12:39.307352 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-64795afb-8a64-4dc2-a6d7-9a1db17c40ae tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:39.308056 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-64795afb-8a64-4dc2-a6d7-9a1db17c40ae tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:39.315103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-64795afb-8a64-4dc2-a6d7-9a1db17c40ae tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:39.315554 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-64795afb-8a64-4dc2-a6d7-9a1db17c40ae tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:39.316313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-64795afb-8a64-4dc2-a6d7-9a1db17c40ae tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:39.316748 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-64795afb-8a64-4dc2-a6d7-9a1db17c40ae tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:39.449642 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-64795afb-8a64-4dc2-a6d7-9a1db17c40ae tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:39.457090 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-64795afb-8a64-4dc2-a6d7-9a1db17c40ae tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.153604 Jul 01 07:12:39.457643 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 244/496] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:39 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:39.690686 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:39.691409 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:39.697484 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:39.697984 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:39.698731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:39.699186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:39.839086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:39.847016 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:39.848500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:39.850202 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-87bc481b-8e1f-4cc8-90c9-14c7227b1e53 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1746 microversion: 2.20 time: 0.164201 Jul 01 07:12:39.850869 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 253/497] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:39 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:40.476467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-4555084d-166e-4e05-bfe5-f54624f65183 req-6f8be51d-8c3f-44ef-b5c6-dcd60da1f31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e3db32-ed35-4c27-ad2f-30bfbe556c25", "name": "network-vif-plugged", "status": "completed", "tag": "37b4518e-4b3f-4f6d-9030-a07d10ba59c5"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:40.479424 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1de610b2-cf58-497e-abd4-a4378820091f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:40.482913 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1de610b2-cf58-497e-abd4-a4378820091f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:40.493988 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1de610b2-cf58-497e-abd4-a4378820091f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:40.494438 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1de610b2-cf58-497e-abd4-a4378820091f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:40.495236 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1de610b2-cf58-497e-abd4-a4378820091f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:40.495668 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1de610b2-cf58-497e-abd4-a4378820091f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:40.500505 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-4555084d-166e-4e05-bfe5-f54624f65183 req-6f8be51d-8c3f-44ef-b5c6-dcd60da1f31d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:40.500947 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-4555084d-166e-4e05-bfe5-f54624f65183 req-6f8be51d-8c3f-44ef-b5c6-dcd60da1f31d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:40.514674 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-4555084d-166e-4e05-bfe5-f54624f65183 req-6f8be51d-8c3f-44ef-b5c6-dcd60da1f31d service nova] Creating event network-vif-plugged:37b4518e-4b3f-4f6d-9030-a07d10ba59c5 for instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 on hv-cinder-80721 Jul 01 07:12:40.519691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-4555084d-166e-4e05-bfe5-f54624f65183 req-6f8be51d-8c3f-44ef-b5c6-dcd60da1f31d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049065 Jul 01 07:12:40.521496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 254/498] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:12:40.664005 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1de610b2-cf58-497e-abd4-a4378820091f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:40.666736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:40.674283 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1de610b2-cf58-497e-abd4-a4378820091f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.204100 Jul 01 07:12:40.674885 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 245/499] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:40 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:40.870124 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:40.870866 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:40.877294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:40.877743 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:40.878508 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:40.878989 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:41.102246 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:41.110334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:41.112621 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:41.114050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-82629be2-4666-4af9-aab1-ae8b861612c3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1746 microversion: 2.20 time: 0.248613 Jul 01 07:12:41.115238 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 255/500] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:40 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1746 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:41.691920 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-df3fa75b-6981-4145-b2b4-455677e47e82 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:41.693067 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-df3fa75b-6981-4145-b2b4-455677e47e82 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:41.695078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:41.695753 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=12 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:41.703919 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-df3fa75b-6981-4145-b2b4-455677e47e82 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:41.704367 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-df3fa75b-6981-4145-b2b4-455677e47e82 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:41.705142 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-df3fa75b-6981-4145-b2b4-455677e47e82 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:41.705755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-df3fa75b-6981-4145-b2b4-455677e47e82 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:41.951865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-df3fa75b-6981-4145-b2b4-455677e47e82 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:41.961698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-df3fa75b-6981-4145-b2b4-455677e47e82 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.273660 Jul 01 07:12:41.962945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 246/501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:41 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:42.132765 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:42.133333 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:42.139992 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:42.140673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:42.141505 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:42.142096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:42.372209 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:42.381569 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:42.383312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:42.384479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2285d099-a944-4214-990e-7c44ce081a3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1746 microversion: 2.20 time: 0.255701 Jul 01 07:12:42.385061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 256/502] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:42 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1746 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:42.979474 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7acc968c-88ee-4615-82e7-e543a0f105be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:42.980084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7acc968c-88ee-4615-82e7-e543a0f105be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:42.982585 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:42.992363 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7acc968c-88ee-4615-82e7-e543a0f105be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:42.992894 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7acc968c-88ee-4615-82e7-e543a0f105be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:42.994098 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7acc968c-88ee-4615-82e7-e543a0f105be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:42.994541 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7acc968c-88ee-4615-82e7-e543a0f105be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:43.261103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7acc968c-88ee-4615-82e7-e543a0f105be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:43.268756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7acc968c-88ee-4615-82e7-e543a0f105be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.292896 Jul 01 07:12:43.269615 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 247/503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:42 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:43.403348 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:43.403959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:43.414825 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:43.415272 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:43.416569 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:43.417305 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:43.586068 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-ebac5885-e653-47f0-b599-72275369e846 req-c79962cb-44b5-40df-bdb3-a7b3ff7bbd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d723a853-e49d-405c-9a21-8ce304f65da8", "name": "network-vif-plugged", "status": "completed", "tag": "342eab1d-fb07-4376-b0e3-5225ba34bca8"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:43.595229 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:43.599623 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-ebac5885-e653-47f0-b599-72275369e846 req-c79962cb-44b5-40df-bdb3-a7b3ff7bbd2c service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:43.600291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-ebac5885-e653-47f0-b599-72275369e846 req-c79962cb-44b5-40df-bdb3-a7b3ff7bbd2c service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:43.606612 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:43.608403 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:43.609808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-314f0edc-a7ad-4d5f-973d-f7fe9b12f458 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1746 microversion: 2.20 time: 0.210212 Jul 01 07:12:43.611150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 257/504] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:43 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1746 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:43.612413 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-ebac5885-e653-47f0-b599-72275369e846 req-c79962cb-44b5-40df-bdb3-a7b3ff7bbd2c service nova] Creating event network-vif-plugged:342eab1d-fb07-4376-b0e3-5225ba34bca8 for instance d723a853-e49d-405c-9a21-8ce304f65da8 on hv-cinder-80721 Jul 01 07:12:43.618198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-ebac5885-e653-47f0-b599-72275369e846 req-c79962cb-44b5-40df-bdb3-a7b3ff7bbd2c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035728 Jul 01 07:12:43.619351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 248/505] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:12:44.287434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9f07b02c-02f1-4cfe-bfc0-b1ffa216940f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:44.288223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9f07b02c-02f1-4cfe-bfc0-b1ffa216940f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:44.295220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f07b02c-02f1-4cfe-bfc0-b1ffa216940f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:44.295780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f07b02c-02f1-4cfe-bfc0-b1ffa216940f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:44.296840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f07b02c-02f1-4cfe-bfc0-b1ffa216940f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:44.298805 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f07b02c-02f1-4cfe-bfc0-b1ffa216940f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:44.457388 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9f07b02c-02f1-4cfe-bfc0-b1ffa216940f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:44.469296 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9f07b02c-02f1-4cfe-bfc0-b1ffa216940f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.186604 Jul 01 07:12:44.469999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 258/506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:44 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:44.630799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:44.632185 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:44.641116 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:44.641928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:44.643011 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:44.643611 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:44.798318 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:44.809068 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:44.812229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:44.813582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6bbba1d0-891d-4aaa-9d62-bffd331a72c5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1746 microversion: 2.20 time: 0.188243 Jul 01 07:12:44.814297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 249/507] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:44 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:45.487467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8981d8d4-8ace-4352-b038-afbb519d5f92 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:45.488312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8981d8d4-8ace-4352-b038-afbb519d5f92 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:45.497308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8981d8d4-8ace-4352-b038-afbb519d5f92 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:45.497758 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8981d8d4-8ace-4352-b038-afbb519d5f92 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:45.498531 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8981d8d4-8ace-4352-b038-afbb519d5f92 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:45.498985 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8981d8d4-8ace-4352-b038-afbb519d5f92 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:45.660762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8981d8d4-8ace-4352-b038-afbb519d5f92 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:45.668652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8981d8d4-8ace-4352-b038-afbb519d5f92 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1365 microversion: 2.1 time: 0.187176 Jul 01 07:12:45.669322 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 259/508] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:45 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:45.832419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:45.833084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:45.840177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:45.840629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:45.841398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:45.842330 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:46.022464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:46.031861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:46.033635 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:46.035064 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4e75bd42-d9d9-4662-887f-013d5f52174b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1746 microversion: 2.20 time: 0.206523 Jul 01 07:12:46.035947 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 250/509] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:45 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1746 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:46.685722 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-11d51f68-039e-4565-8982-eefe5d2118b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:46.686521 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-11d51f68-039e-4565-8982-eefe5d2118b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:46.694349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-11d51f68-039e-4565-8982-eefe5d2118b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:46.694912 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-11d51f68-039e-4565-8982-eefe5d2118b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:46.695765 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-11d51f68-039e-4565-8982-eefe5d2118b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:46.696459 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-11d51f68-039e-4565-8982-eefe5d2118b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:46.985831 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-11d51f68-039e-4565-8982-eefe5d2118b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:46.995307 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-11d51f68-039e-4565-8982-eefe5d2118b4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1556 microversion: 2.1 time: 0.313715 Jul 01 07:12:46.996209 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 260/510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:12:46 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1556 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:12:47.012253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-868499ce-871f-484f-88c8-4eb705883fce tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:47.012831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-868499ce-871f-484f-88c8-4eb705883fce tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:47.019737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-868499ce-871f-484f-88c8-4eb705883fce tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:47.020219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-868499ce-871f-484f-88c8-4eb705883fce tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:47.021819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-868499ce-871f-484f-88c8-4eb705883fce tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:47.022987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-868499ce-871f-484f-88c8-4eb705883fce tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:47.055517 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:47.056339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:47.073634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:47.074334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:47.075319 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:47.075760 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:47.201906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-868499ce-871f-484f-88c8-4eb705883fce tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193517 Jul 01 07:12:47.202943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 251/511] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jul 1 07:12:47 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:12:47.370533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:47.381074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:47.392523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:47.396435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e20be65b-a242-4f08-bb25-f6ea7fdd1b7e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1746 microversion: 2.20 time: 0.345237 Jul 01 07:12:47.401208 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 261/512] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:47 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1746 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:48.426506 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:48.429830 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:48.439664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:48.440123 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:48.441848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:48.441848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:48.821092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-ca8a8831-8215-4819-b12b-7e482c5b7e4b req-36afcecc-c355-44d4-8f6f-3f2eb1762100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d723a853-e49d-405c-9a21-8ce304f65da8", "tag": "342eab1d-fb07-4376-b0e3-5225ba34bca8"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:12:48.835135 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=47 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:12:48.839134 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-ca8a8831-8215-4819-b12b-7e482c5b7e4b req-36afcecc-c355-44d4-8f6f-3f2eb1762100 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:48.840020 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-ca8a8831-8215-4819-b12b-7e482c5b7e4b req-36afcecc-c355-44d4-8f6f-3f2eb1762100 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:48.884068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-ca8a8831-8215-4819-b12b-7e482c5b7e4b req-36afcecc-c355-44d4-8f6f-3f2eb1762100 service nova] Creating event network-changed:342eab1d-fb07-4376-b0e3-5225ba34bca8 for instance d723a853-e49d-405c-9a21-8ce304f65da8 on hv-cinder-80721 Jul 01 07:12:48.898354 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-ca8a8831-8215-4819-b12b-7e482c5b7e4b req-36afcecc-c355-44d4-8f6f-3f2eb1762100 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078700 Jul 01 07:12:48.912496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 262/513] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:12:49.401840 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:49.425673 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:49.427374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:49.432676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3511ca36-9ceb-43be-be92-1452bc0c2478 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 1.016701 Jul 01 07:12:49.435262 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 252/514] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:48 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:50.456398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:50.457110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:50.470480 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:50.474543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:50.475476 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:50.475927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:50.774019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:50.799000 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:50.800679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:50.802153 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2b17633c-cea9-45a9-8c05-f36fac734003 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.351925 Jul 01 07:12:50.804502 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 263/515] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:50 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:51.822939 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:51.823926 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:51.836946 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:51.843472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:51.844787 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:51.845857 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:52.089233 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:52.105973 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:52.112106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:52.113952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5129d929-6c60-45bd-aec2-b05a0238229e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.296957 Jul 01 07:12:52.115897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 253/516] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:51 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:53.134661 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:53.135920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:53.142987 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:53.143797 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:53.144755 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:53.145919 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:53.354406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:53.363676 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:53.365906 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:53.367294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c572251d-28ee-4c4d-b371-099032149949 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.236696 Jul 01 07:12:53.368296 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 264/517] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:53 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:54.385982 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:54.387298 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:54.394401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:54.394893 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:54.396585 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:54.397034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:54.627594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:54.639131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:54.644446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:54.646521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-24e09bc5-3af5-44b0-8682-d3414d4a3ce9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.264376 Jul 01 07:12:54.647292 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 254/518] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:54 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:55.665783 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:55.666948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:55.691271 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:55.703872 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:55.704745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:55.705198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:56.139582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:56.158105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:56.160127 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:56.162129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a81ff84d-993d-4c7d-b03d-621407732143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.501065 Jul 01 07:12:56.162727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 265/519] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:55 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:57.180779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:57.183112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:57.231942 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:57.232703 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:57.233972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:57.235018 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:57.412088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:57.420906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:57.422401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:57.423596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3b306bb9-ff9e-4c14-a02d-d1b716b7cb66 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.246741 Jul 01 07:12:57.436536 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 255/520] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:57 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:12:58.446184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:58.447632 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:58.460291 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:58.460754 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:58.466065 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:58.466309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:58.663911 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:58.675996 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:58.679222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:58.680792 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-02442b9c-cf51-4f88-916e-f0c1c990e527 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.238864 Jul 01 07:12:58.693519 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 266/521] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:58 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:12:59.703955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:12:59.704587 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:12:59.715133 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:59.715601 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:59.722954 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:12:59.724329 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:12:59.962385 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:59.972352 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:59.975052 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:12:59.978118 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a3aec440-3c80-4461-b8e3-ddf3f2b2af5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.280737 Jul 01 07:12:59.990582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 256/522] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:12:59 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:01.005937 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:01.008044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:01.015232 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:01.016485 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:01.017478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:01.018373 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:01.230291 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:01.259715 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:01.261566 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:01.262988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e8fc081d-a6ff-4efe-8299-378a5be56591 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.270249 Jul 01 07:13:01.266907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 267/523] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:00 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:02.309431 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:02.309431 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:02.314712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:02.315094 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:02.316079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:02.316746 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:02.480781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:02.489584 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:02.491196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:02.492362 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-edc2e63b-ca72-46af-9489-f75113588754 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.194964 Jul 01 07:13:02.492913 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 257/524] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:02 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:03.509538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:03.510270 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:03.517223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:03.517801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:03.518848 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:03.519511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:03.665726 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:03.679186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:03.680677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:03.681835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3fea690e-06be-44f0-88c9-35c267c5603e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.176332 Jul 01 07:13:03.682382 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 268/525] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:03 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:04.509311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a0b2ec93-7a60-4584-82ff-a4a6aaea87b3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Action: 'create', calling method: .version_select at 0x7f2c4a507940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1914254518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0d4J1sQWg32uizzKwCsQhC+9ARsBfG36Q5oQVSCcO9XDFaJrgB0Sry7N9yDDbpZLsjwc9+jD59xmuRpgeEh08HQ5ZkTXJeyrMuKlq5mwfRUAB/7Q3DRZSXvh1aiLt2tQ=="}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:04.524113 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-a0b2ec93-7a60-4584-82ff-a4a6aaea87b3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Getting quotas for project ce460f857d824071927f15e19cbb11e7. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:13:04.527917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-a0b2ec93-7a60-4584-82ff-a4a6aaea87b3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Getting quotas for user 631f377cb70b454cbde19de83676f502 and project ce460f857d824071927f15e19cbb11e7. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:13:04.549047 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a0b2ec93-7a60-4584-82ff-a4a6aaea87b3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043697 Jul 01 07:13:04.549632 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 258/526] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:13:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:13:04.596541 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-278535726", "imageRef": "b12f8aec-d8d0-4fac-adf0-85d32c904e52", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1914254518", "networks": [{"uuid": "00b93e86-7c45-4c05-a13d-c55347455da6"}]}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:04.650953 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] validate_networks() for [('00b93e86-7c45-4c05-a13d-c55347455da6', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:13:04.700930 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:04.701545 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:04.707500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:04.707945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:04.708705 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:04.709140 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:04.905649 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:04.914265 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:04.915894 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:04.917122 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-746dabd1-98fd-4730-882a-5183d8e965a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.220130 Jul 01 07:13:04.917684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 259/527] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:04 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:05.090793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:13:05.091218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:13:05.091683 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:13:05.092084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:13:05.092488 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:13:05.101192 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:05.101630 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:05.102416 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:05.102877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:05.118940 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Getting quotas for project ce460f857d824071927f15e19cbb11e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:13:05.122823 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Getting quotas for user 631f377cb70b454cbde19de83676f502 and project ce460f857d824071927f15e19cbb11e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:13:05.133815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:13:05.135956 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b12f8aec-d8d0-4fac-adf0-85d32c904e52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:13:05.180029 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d7504038-48b8-4899-80e4-b9c3aa82f9dc tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587048 Jul 01 07:13:05.180667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 269/528] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:13:05.190671 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f16ad35d-9892-4ce0-9249-782c7a6888c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:05.191322 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f16ad35d-9892-4ce0-9249-782c7a6888c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:05.243815 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f16ad35d-9892-4ce0-9249-782c7a6888c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:05.250336 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f16ad35d-9892-4ce0-9249-782c7a6888c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1258 microversion: 2.1 time: 0.063544 Jul 01 07:13:05.250920 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 260/529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:05 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:05.935640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:05.936252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:05.944109 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:05.944557 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:05.945322 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:05.945766 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:06.077695 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:06.081191 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:06.086380 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:06.087912 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:06.089087 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b0dfb067-7161-444b-aedb-afa1640f9f3b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.157730 Jul 01 07:13:06.089639 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 270/530] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:05 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:06.267960 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1bb22a51-58b0-433a-8cfe-f9feadc2e12f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:06.268574 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1bb22a51-58b0-433a-8cfe-f9feadc2e12f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:06.275084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1bb22a51-58b0-433a-8cfe-f9feadc2e12f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:06.275532 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1bb22a51-58b0-433a-8cfe-f9feadc2e12f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:06.276287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1bb22a51-58b0-433a-8cfe-f9feadc2e12f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:06.276724 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1bb22a51-58b0-433a-8cfe-f9feadc2e12f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:06.339217 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1bb22a51-58b0-433a-8cfe-f9feadc2e12f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:06.346526 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1bb22a51-58b0-433a-8cfe-f9feadc2e12f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1262 microversion: 2.1 time: 0.082421 Jul 01 07:13:06.347121 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 261/531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:06 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:07.107037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:07.107650 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:07.114862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:07.115306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:07.116057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:07.116484 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:07.244374 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:07.252267 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:07.253808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:07.255487 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-26ccc85c-77ba-4aa7-bf6a-aef5e6c54561 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.152378 Jul 01 07:13:07.256045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 271/532] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:07 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:07.362256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3feaa2ab-fcba-4767-8394-64ede4dceaa5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:07.362825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3feaa2ab-fcba-4767-8394-64ede4dceaa5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:07.369278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3feaa2ab-fcba-4767-8394-64ede4dceaa5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:07.369723 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3feaa2ab-fcba-4767-8394-64ede4dceaa5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:07.370482 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3feaa2ab-fcba-4767-8394-64ede4dceaa5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:07.370947 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3feaa2ab-fcba-4767-8394-64ede4dceaa5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:07.437744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3feaa2ab-fcba-4767-8394-64ede4dceaa5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:07.445516 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3feaa2ab-fcba-4767-8394-64ede4dceaa5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1254 microversion: 2.1 time: 0.087092 Jul 01 07:13:07.446085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 262/533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:07 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1254 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:08.274504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:08.275167 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:08.281674 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:08.282130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:08.282928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:08.283365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:08.412338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:08.420307 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:08.421804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:08.422999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a3acb4e9-fad2-4c99-97de-0b6d3b1e17bd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1741 microversion: 2.20 time: 0.152315 Jul 01 07:13:08.423557 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 272/534] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:08 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:08.463141 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4392a7bb-d90c-4f42-9409-f91e5603286a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:08.463744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4392a7bb-d90c-4f42-9409-f91e5603286a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:08.470281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4392a7bb-d90c-4f42-9409-f91e5603286a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:08.470666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4392a7bb-d90c-4f42-9409-f91e5603286a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:08.471461 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4392a7bb-d90c-4f42-9409-f91e5603286a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:08.471895 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4392a7bb-d90c-4f42-9409-f91e5603286a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:08.532177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4392a7bb-d90c-4f42-9409-f91e5603286a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:08.539986 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4392a7bb-d90c-4f42-9409-f91e5603286a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1310 microversion: 2.1 time: 0.080627 Jul 01 07:13:08.540546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 263/535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:08 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:09.444658 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:09.445951 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:09.457753 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:09.458548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:09.459953 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:09.460646 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:09.556564 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-33413e35-3fac-4b8a-b4f7-bbcb56d2f86b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:09.557084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-33413e35-3fac-4b8a-b4f7-bbcb56d2f86b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:09.571538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-33413e35-3fac-4b8a-b4f7-bbcb56d2f86b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:09.571967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-33413e35-3fac-4b8a-b4f7-bbcb56d2f86b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:09.572745 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-33413e35-3fac-4b8a-b4f7-bbcb56d2f86b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:09.573175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-33413e35-3fac-4b8a-b4f7-bbcb56d2f86b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:09.772378 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-33413e35-3fac-4b8a-b4f7-bbcb56d2f86b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:09.779676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-33413e35-3fac-4b8a-b4f7-bbcb56d2f86b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1316 microversion: 2.1 time: 0.227030 Jul 01 07:13:09.780252 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 264/536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:09 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:09.855434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:09.864924 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:09.866749 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:09.867967 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a40b843b-5c04-4bd6-874c-b8699c8aec5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.430232 Jul 01 07:13:09.870817 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 273/537] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:09 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:10.346397 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-989810f6-4775-4b95-893e-ba2a76421693 req-b193c678-db00-41cd-ab43-79665ae8d1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e3db32-ed35-4c27-ad2f-30bfbe556c25", "name": "network-vif-unplugged", "status": "completed", "tag": "37b4518e-4b3f-4f6d-9030-a07d10ba59c5"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:10.357196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-989810f6-4775-4b95-893e-ba2a76421693 req-b193c678-db00-41cd-ab43-79665ae8d1b0 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:10.358175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-989810f6-4775-4b95-893e-ba2a76421693 req-b193c678-db00-41cd-ab43-79665ae8d1b0 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:10.371397 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-989810f6-4775-4b95-893e-ba2a76421693 req-b193c678-db00-41cd-ab43-79665ae8d1b0 service nova] Creating event network-vif-unplugged:37b4518e-4b3f-4f6d-9030-a07d10ba59c5 for instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 on hv-cinder-80721 Jul 01 07:13:10.376507 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-989810f6-4775-4b95-893e-ba2a76421693 req-b193c678-db00-41cd-ab43-79665ae8d1b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034687 Jul 01 07:13:10.377522 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 265/538] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:13:10.796794 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-77a16064-0093-4910-b986-fcfe9fe09da9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:10.797406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-77a16064-0093-4910-b986-fcfe9fe09da9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:10.804278 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77a16064-0093-4910-b986-fcfe9fe09da9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:10.804478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77a16064-0093-4910-b986-fcfe9fe09da9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:10.805237 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77a16064-0093-4910-b986-fcfe9fe09da9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:10.805666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77a16064-0093-4910-b986-fcfe9fe09da9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:10.888744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:10.889339 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:10.896343 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:10.896866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:10.897743 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:10.898188 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:10.901274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:10.956491 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-77a16064-0093-4910-b986-fcfe9fe09da9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:10.965065 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-77a16064-0093-4910-b986-fcfe9fe09da9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.171967 Jul 01 07:13:10.980123 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 274/539] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:10 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:11.041393 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:11.049217 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:11.050731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:11.051887 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-17d32aac-d3f6-4e34-b696-ccdd1c563747 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.168006 Jul 01 07:13:11.052442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 266/540] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:10 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:11.861536 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-12914203-ef0c-4a70-a90f-92fb468d0bd6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:11.862068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-12914203-ef0c-4a70-a90f-92fb468d0bd6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:11.868565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-12914203-ef0c-4a70-a90f-92fb468d0bd6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:11.869010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-12914203-ef0c-4a70-a90f-92fb468d0bd6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:11.869773 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-12914203-ef0c-4a70-a90f-92fb468d0bd6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:11.870203 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-12914203-ef0c-4a70-a90f-92fb468d0bd6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:11.989254 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0d15de74-ce6e-449e-bb2d-ad706d9b9f32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:11.990080 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0d15de74-ce6e-449e-bb2d-ad706d9b9f32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:11.997299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0d15de74-ce6e-449e-bb2d-ad706d9b9f32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:11.997751 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0d15de74-ce6e-449e-bb2d-ad706d9b9f32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:11.998625 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0d15de74-ce6e-449e-bb2d-ad706d9b9f32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:11.999083 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0d15de74-ce6e-449e-bb2d-ad706d9b9f32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:12.005027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-12914203-ef0c-4a70-a90f-92fb468d0bd6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lazy-loading 'services' on Instance uuid 8656e950-5648-4618-8903-c7a23f9f5c46 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:13:12.141592 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-12914203-ef0c-4a70-a90f-92fb468d0bd6 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46/os-volume_attachments/9a447bb2-2304-463c-b243-dbe5e6c78e91" status: 202 len: 0 microversion: 2.1 time: 0.283747 Jul 01 07:13:12.142598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 275/541] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:13:11 2022] DELETE /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46/os-volume_attachments/9a447bb2-2304-463c-b243-dbe5e6c78e91 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:13:12.149888 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0d15de74-ce6e-449e-bb2d-ad706d9b9f32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:12.158086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:12.158255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0d15de74-ce6e-449e-bb2d-ad706d9b9f32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.173351 Jul 01 07:13:12.158691 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 267/542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:11 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:12.167175 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:12.173780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:12.174227 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:12.175037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:12.175468 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:12.322315 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:12.330465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:12.332051 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:12.333216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-488ed4e5-301d-4eff-bd48-d54cc3a7f27f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.189742 Jul 01 07:13:12.333769 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 276/543] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:12 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:13.174845 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-045e4beb-e793-4689-a22f-9ac305ec8315 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:13.175591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-045e4beb-e793-4689-a22f-9ac305ec8315 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:13.177778 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:13.183074 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-045e4beb-e793-4689-a22f-9ac305ec8315 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:13.183520 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-045e4beb-e793-4689-a22f-9ac305ec8315 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:13.184555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-045e4beb-e793-4689-a22f-9ac305ec8315 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:13.184987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-045e4beb-e793-4689-a22f-9ac305ec8315 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:13.337616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-045e4beb-e793-4689-a22f-9ac305ec8315 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:13.351381 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:13.351995 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:13.352491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-045e4beb-e793-4689-a22f-9ac305ec8315 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.181208 Jul 01 07:13:13.353189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 268/544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:13 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:13.358538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:13.359023 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:13.359787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:13.360221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:13.498422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:13.507014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:13.508523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:13.509681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7bf57283-3836-42e4-aa83-4d96146c6e7c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.162196 Jul 01 07:13:13.510242 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 277/545] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:13 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:14.369335 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-44f6efbb-1f56-4a32-ad8a-4f759c341bfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:14.369944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-44f6efbb-1f56-4a32-ad8a-4f759c341bfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:14.376926 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-44f6efbb-1f56-4a32-ad8a-4f759c341bfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:14.377469 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-44f6efbb-1f56-4a32-ad8a-4f759c341bfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:14.378278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-44f6efbb-1f56-4a32-ad8a-4f759c341bfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:14.378723 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-44f6efbb-1f56-4a32-ad8a-4f759c341bfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:14.509982 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-44f6efbb-1f56-4a32-ad8a-4f759c341bfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:14.517905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-44f6efbb-1f56-4a32-ad8a-4f759c341bfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.152354 Jul 01 07:13:14.518481 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 269/546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:14 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:14.527570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:14.528788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:14.536108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:14.536499 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:14.537481 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:14.537931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:14.673386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:14.682526 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:14.684021 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:14.685438 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d13e2a19-1710-4a9e-9b7a-ebbe52e68efd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.162132 Jul 01 07:13:14.685986 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 278/547] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:14 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:15.535465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d16f94c3-7a16-4e37-bdfb-18a73f614001 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:15.536087 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d16f94c3-7a16-4e37-bdfb-18a73f614001 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:15.538000 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=6 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:15.545238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d16f94c3-7a16-4e37-bdfb-18a73f614001 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:15.546073 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d16f94c3-7a16-4e37-bdfb-18a73f614001 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:15.547230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d16f94c3-7a16-4e37-bdfb-18a73f614001 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:15.547674 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d16f94c3-7a16-4e37-bdfb-18a73f614001 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:15.683666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d16f94c3-7a16-4e37-bdfb-18a73f614001 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:15.692396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d16f94c3-7a16-4e37-bdfb-18a73f614001 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.160226 Jul 01 07:13:15.692967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 270/548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:15 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:15.703318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:15.704072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:15.706015 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:15.706695 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=6 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:15.713815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:15.714256 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:15.715039 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:15.715464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:16.029486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:16.038458 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:16.040029 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:16.041259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-123f3ec0-7a13-48c4-b1f8-a43309e484cc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.342070 Jul 01 07:13:16.041813 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 279/549] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:15 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:16.710297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7cb9fdc2-7055-4424-914e-68718ebff08d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:16.710906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7cb9fdc2-7055-4424-914e-68718ebff08d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:16.717607 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7cb9fdc2-7055-4424-914e-68718ebff08d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:16.718404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7cb9fdc2-7055-4424-914e-68718ebff08d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:16.719466 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7cb9fdc2-7055-4424-914e-68718ebff08d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:16.719976 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7cb9fdc2-7055-4424-914e-68718ebff08d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:16.855094 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7cb9fdc2-7055-4424-914e-68718ebff08d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:16.863762 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7cb9fdc2-7055-4424-914e-68718ebff08d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.157898 Jul 01 07:13:16.864530 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 271/550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:16 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:17.062374 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:17.063034 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:17.069880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:17.070322 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:17.071115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:17.071547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:17.230150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:17.240178 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:17.242149 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:17.243637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-af77ccce-f5ad-4d48-b6a7-bd6dba8a0c04 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.186330 Jul 01 07:13:17.244301 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 280/551] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:17 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:17.881108 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f6b20720-fc41-4608-84a3-23f578a516f8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:17.881709 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f6b20720-fc41-4608-84a3-23f578a516f8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:17.888299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f6b20720-fc41-4608-84a3-23f578a516f8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:17.888750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f6b20720-fc41-4608-84a3-23f578a516f8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:17.889500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f6b20720-fc41-4608-84a3-23f578a516f8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:17.889927 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f6b20720-fc41-4608-84a3-23f578a516f8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:18.081039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f6b20720-fc41-4608-84a3-23f578a516f8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:18.088610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f6b20720-fc41-4608-84a3-23f578a516f8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.211785 Jul 01 07:13:18.089168 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 272/552] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:17 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:18.263280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:18.264104 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:18.272139 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:18.272671 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:18.273524 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:18.274032 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:18.408879 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:18.417747 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:18.419266 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:18.420423 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5bb7cc4f-aa37-4625-b4f7-20bf846e04bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.162962 Jul 01 07:13:18.420977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 281/553] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:18 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:19.104839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-42dc9cd8-9a2f-4d81-934d-0e4b44c7ebcb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:19.105448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-42dc9cd8-9a2f-4d81-934d-0e4b44c7ebcb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:19.112010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-42dc9cd8-9a2f-4d81-934d-0e4b44c7ebcb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:19.112461 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-42dc9cd8-9a2f-4d81-934d-0e4b44c7ebcb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:19.113267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-42dc9cd8-9a2f-4d81-934d-0e4b44c7ebcb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:19.113702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-42dc9cd8-9a2f-4d81-934d-0e4b44c7ebcb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:19.258348 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-42dc9cd8-9a2f-4d81-934d-0e4b44c7ebcb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:19.268537 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-42dc9cd8-9a2f-4d81-934d-0e4b44c7ebcb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.167358 Jul 01 07:13:19.269316 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 273/554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:19 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:19.438657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:19.439246 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:19.442300 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:19.447822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:19.448273 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:19.449049 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:19.449481 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:19.588743 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:19.598334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:19.600365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:19.601905 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-69a0c7a8-0ebe-4b3d-a2df-13c88ccb3f0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.167509 Jul 01 07:13:19.602705 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 282/555] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:19 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:20.288420 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-170cbb6d-3573-4c6e-82b0-6aa062ba4615 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:20.288982 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-170cbb6d-3573-4c6e-82b0-6aa062ba4615 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:20.295535 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-170cbb6d-3573-4c6e-82b0-6aa062ba4615 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:20.296053 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-170cbb6d-3573-4c6e-82b0-6aa062ba4615 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:20.296831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-170cbb6d-3573-4c6e-82b0-6aa062ba4615 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:20.297306 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-170cbb6d-3573-4c6e-82b0-6aa062ba4615 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:20.432828 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-170cbb6d-3573-4c6e-82b0-6aa062ba4615 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:20.442027 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-170cbb6d-3573-4c6e-82b0-6aa062ba4615 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.158116 Jul 01 07:13:20.442986 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 274/556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:20 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:20.620279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:20.620950 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:20.627446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:20.627898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:20.629201 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:20.629628 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:21.009248 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:21.017427 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:21.019044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:21.020267 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c6a74b1d-84a9-4db6-af4a-82cda4136916 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.403890 Jul 01 07:13:21.021042 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 283/557] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:20 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:21.460127 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e03f0b7a-496a-475e-8ea5-2a2115d19dd1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:21.460915 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e03f0b7a-496a-475e-8ea5-2a2115d19dd1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:21.467884 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e03f0b7a-496a-475e-8ea5-2a2115d19dd1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:21.468274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e03f0b7a-496a-475e-8ea5-2a2115d19dd1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:21.469075 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e03f0b7a-496a-475e-8ea5-2a2115d19dd1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:21.469558 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e03f0b7a-496a-475e-8ea5-2a2115d19dd1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:21.607165 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e03f0b7a-496a-475e-8ea5-2a2115d19dd1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:21.614730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e03f0b7a-496a-475e-8ea5-2a2115d19dd1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.159363 Jul 01 07:13:21.615306 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 275/558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:21 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:22.038835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:22.039402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:22.045831 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:22.046277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:22.047060 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:22.047495 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:22.178207 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:22.186253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:22.187774 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:22.188925 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0f51b148-f723-4b54-8a52-5df1abc76588 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.154576 Jul 01 07:13:22.189486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 284/559] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:22 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:22.631854 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f37f740f-894f-4619-837a-34cb243435aa tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:22.632463 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f37f740f-894f-4619-837a-34cb243435aa tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:22.638966 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f37f740f-894f-4619-837a-34cb243435aa tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:22.639414 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f37f740f-894f-4619-837a-34cb243435aa tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:22.640161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f37f740f-894f-4619-837a-34cb243435aa tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:22.640589 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f37f740f-894f-4619-837a-34cb243435aa tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:22.765367 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f37f740f-894f-4619-837a-34cb243435aa tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:22.773256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f37f740f-894f-4619-837a-34cb243435aa tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.145267 Jul 01 07:13:22.773821 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 276/560] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:22 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:23.207094 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:23.207776 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:23.214158 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:23.214603 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:23.215391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:23.215821 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:23.344286 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:23.352013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:23.353504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:23.354645 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c42edd2f-4063-41da-9260-3017e3eb3143 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.151489 Jul 01 07:13:23.355223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 285/561] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:23 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:23.790458 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3b39e9fc-0ba6-4f89-b5f7-4e527d181627 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:23.791092 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3b39e9fc-0ba6-4f89-b5f7-4e527d181627 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:23.797618 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3b39e9fc-0ba6-4f89-b5f7-4e527d181627 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:23.798065 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3b39e9fc-0ba6-4f89-b5f7-4e527d181627 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:23.798852 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3b39e9fc-0ba6-4f89-b5f7-4e527d181627 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:23.799291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3b39e9fc-0ba6-4f89-b5f7-4e527d181627 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:23.924499 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3b39e9fc-0ba6-4f89-b5f7-4e527d181627 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:23.932495 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3b39e9fc-0ba6-4f89-b5f7-4e527d181627 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.145865 Jul 01 07:13:23.933063 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 277/562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:23 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:24.373172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:24.373773 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:24.380739 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:24.381180 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:24.381931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:24.382364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:24.507726 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:24.511092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:24.516259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:24.517740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:24.518896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8d281c54-d4ab-4610-8e60-892a619ed25d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.149582 Jul 01 07:13:24.520088 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 286/563] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:24 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:24.949268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-367ea43c-9b83-47f8-a3ce-5edbd9d6cb08 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:24.949875 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-367ea43c-9b83-47f8-a3ce-5edbd9d6cb08 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:24.956387 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-367ea43c-9b83-47f8-a3ce-5edbd9d6cb08 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:24.956883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-367ea43c-9b83-47f8-a3ce-5edbd9d6cb08 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:24.957716 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-367ea43c-9b83-47f8-a3ce-5edbd9d6cb08 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:24.958158 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-367ea43c-9b83-47f8-a3ce-5edbd9d6cb08 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:25.228962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-367ea43c-9b83-47f8-a3ce-5edbd9d6cb08 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:25.236356 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-367ea43c-9b83-47f8-a3ce-5edbd9d6cb08 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.290891 Jul 01 07:13:25.236937 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 278/564] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:24 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:25.538121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:25.538727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:25.554666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:25.555305 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:25.556209 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:25.557121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:25.817287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:25.826310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:25.827880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:25.829039 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f062b8a4-cf8e-462c-884e-dda847ee3c5c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.295869 Jul 01 07:13:25.829867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 287/565] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:25 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:25.919822 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-41127d02-fa50-46a9-b92f-23efda5bcc09 req-b858cad4-c022-4425-9b6c-402e34de333d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a035c87f-f7c1-4663-babc-7e64de9f1718", "tag": "a0ad1989-7e46-4e7a-a4e2-e30646d4df95"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:25.928808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-41127d02-fa50-46a9-b92f-23efda5bcc09 req-b858cad4-c022-4425-9b6c-402e34de333d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:25.929519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-41127d02-fa50-46a9-b92f-23efda5bcc09 req-b858cad4-c022-4425-9b6c-402e34de333d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:25.942850 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-41127d02-fa50-46a9-b92f-23efda5bcc09 req-b858cad4-c022-4425-9b6c-402e34de333d service nova] Creating event network-changed:a0ad1989-7e46-4e7a-a4e2-e30646d4df95 for instance a035c87f-f7c1-4663-babc-7e64de9f1718 on hv-cinder-80721 Jul 01 07:13:25.948172 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-41127d02-fa50-46a9-b92f-23efda5bcc09 req-b858cad4-c022-4425-9b6c-402e34de333d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031970 Jul 01 07:13:25.948799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 279/566] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:13:26.254154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-acb952a0-ecec-473a-8879-255b508712a5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:26.254701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-acb952a0-ecec-473a-8879-255b508712a5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:26.260764 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-acb952a0-ecec-473a-8879-255b508712a5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:26.261214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-acb952a0-ecec-473a-8879-255b508712a5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:26.261973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-acb952a0-ecec-473a-8879-255b508712a5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:26.262407 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-acb952a0-ecec-473a-8879-255b508712a5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:26.386736 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-acb952a0-ecec-473a-8879-255b508712a5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:26.394085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-acb952a0-ecec-473a-8879-255b508712a5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.144491 Jul 01 07:13:26.394645 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 288/567] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:26 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:26.850060 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:26.850749 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:26.856919 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:26.857366 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:26.858119 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:26.858548 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:26.999803 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:27.007754 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:27.009268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:27.010424 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2f7a6218-06d8-43c3-af8c-73b1eb40f540 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.165612 Jul 01 07:13:27.011002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 280/568] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:26 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:27.028999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f15ee727-3aef-4185-9fa9-a23f645141ba tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:27.029556 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f15ee727-3aef-4185-9fa9-a23f645141ba tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:27.037057 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f15ee727-3aef-4185-9fa9-a23f645141ba tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:27.037514 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f15ee727-3aef-4185-9fa9-a23f645141ba tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:27.038286 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f15ee727-3aef-4185-9fa9-a23f645141ba tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:27.038798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f15ee727-3aef-4185-9fa9-a23f645141ba tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:27.063176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f15ee727-3aef-4185-9fa9-a23f645141ba tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:13:27.143278 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f15ee727-3aef-4185-9fa9-a23f645141ba tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 204 len: 0 microversion: 2.1 time: 0.117825 Jul 01 07:13:27.143837 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 289/569] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:13:27 2022] DELETE /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:13:27.152449 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-616928c1-8e00-4894-8466-ab2d502ecea0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:27.153089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-616928c1-8e00-4894-8466-ab2d502ecea0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:27.158986 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-616928c1-8e00-4894-8466-ab2d502ecea0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:27.159432 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-616928c1-8e00-4894-8466-ab2d502ecea0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:27.160786 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-616928c1-8e00-4894-8466-ab2d502ecea0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:27.161213 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-616928c1-8e00-4894-8466-ab2d502ecea0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:27.292570 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-616928c1-8e00-4894-8466-ab2d502ecea0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:27.300521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-616928c1-8e00-4894-8466-ab2d502ecea0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1559 microversion: 2.1 time: 0.151832 Jul 01 07:13:27.301084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 281/570] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:27 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:27.412050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bb8a8620-144a-48de-a616-f4b30c32b9ad tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:27.412665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bb8a8620-144a-48de-a616-f4b30c32b9ad tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:27.418721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bb8a8620-144a-48de-a616-f4b30c32b9ad tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:27.419388 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bb8a8620-144a-48de-a616-f4b30c32b9ad tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:27.420155 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bb8a8620-144a-48de-a616-f4b30c32b9ad tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:27.420585 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bb8a8620-144a-48de-a616-f4b30c32b9ad tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:27.552233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-bb8a8620-144a-48de-a616-f4b30c32b9ad tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:27.559946 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bb8a8620-144a-48de-a616-f4b30c32b9ad tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.152908 Jul 01 07:13:27.560497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 290/571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:27 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:28.029217 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:28.029828 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:28.036919 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:28.037379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:28.038132 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:28.038560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:28.165929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:28.173826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:28.175392 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:28.176542 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4ccf9c08-dcae-4784-b536-a0018fc736dc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1723 microversion: 2.20 time: 0.151153 Jul 01 07:13:28.177124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 282/572] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:28 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:28.318141 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-24321543-dcfb-492f-8786-91d2ff419f5a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:28.318717 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-24321543-dcfb-492f-8786-91d2ff419f5a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:28.325125 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-24321543-dcfb-492f-8786-91d2ff419f5a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:28.325574 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-24321543-dcfb-492f-8786-91d2ff419f5a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:28.326338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-24321543-dcfb-492f-8786-91d2ff419f5a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:28.326786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-24321543-dcfb-492f-8786-91d2ff419f5a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:28.456234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-24321543-dcfb-492f-8786-91d2ff419f5a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:28.463721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-24321543-dcfb-492f-8786-91d2ff419f5a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1513 microversion: 2.1 time: 0.150003 Jul 01 07:13:28.464277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 291/573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:28 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:28.576490 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bd4c93bd-0fe2-45b7-acf4-b9491b869156 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:28.577022 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bd4c93bd-0fe2-45b7-acf4-b9491b869156 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:28.582984 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bd4c93bd-0fe2-45b7-acf4-b9491b869156 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:28.583428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bd4c93bd-0fe2-45b7-acf4-b9491b869156 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:28.584183 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bd4c93bd-0fe2-45b7-acf4-b9491b869156 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:28.584609 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bd4c93bd-0fe2-45b7-acf4-b9491b869156 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:28.598790 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=100 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:28.708436 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bd4c93bd-0fe2-45b7-acf4-b9491b869156 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:28.715701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bd4c93bd-0fe2-45b7-acf4-b9491b869156 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.143106 Jul 01 07:13:28.716251 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 283/574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:28 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:29.194966 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:29.195677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:29.202220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.202749 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.203647 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.204190 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.330409 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:29.338882 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:29.340338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:29.341487 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4848c258-01cd-4d1a-a6e2-bf75aa45afde tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1726 microversion: 2.20 time: 0.150543 Jul 01 07:13:29.342052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 292/575] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:29 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:29.359694 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f4e0046b-6b9b-4aeb-bb1c-5cfb824171b6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0111bfda-40ac-4767-a473-a7b6d81a78e7"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:29.360726 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f4e0046b-6b9b-4aeb-bb1c-5cfb824171b6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:29.367215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f4e0046b-6b9b-4aeb-bb1c-5cfb824171b6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.367663 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f4e0046b-6b9b-4aeb-bb1c-5cfb824171b6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.368421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f4e0046b-6b9b-4aeb-bb1c-5cfb824171b6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.368857 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f4e0046b-6b9b-4aeb-bb1c-5cfb824171b6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.480507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c0574e0a-ce4b-4b92-8350-0dcd13ef6f73 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:29.481253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c0574e0a-ce4b-4b92-8350-0dcd13ef6f73 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:29.487259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0574e0a-ce4b-4b92-8350-0dcd13ef6f73 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.487709 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0574e0a-ce4b-4b92-8350-0dcd13ef6f73 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.488477 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0574e0a-ce4b-4b92-8350-0dcd13ef6f73 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.488913 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0574e0a-ce4b-4b92-8350-0dcd13ef6f73 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.655306 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f4e0046b-6b9b-4aeb-bb1c-5cfb824171b6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299832 Jul 01 07:13:29.655974 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 284/576] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jul 1 07:13:29 2022] POST /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 07:13:29.732360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c4db8c7d-d431-4c88-b2f7-f07d7524ae39 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:29.733061 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c4db8c7d-d431-4c88-b2f7-f07d7524ae39 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:29.740114 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c4db8c7d-d431-4c88-b2f7-f07d7524ae39 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.740643 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c4db8c7d-d431-4c88-b2f7-f07d7524ae39 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.741476 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c4db8c7d-d431-4c88-b2f7-f07d7524ae39 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.741971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c4db8c7d-d431-4c88-b2f7-f07d7524ae39 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.755698 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c0574e0a-ce4b-4b92-8350-0dcd13ef6f73 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:29.770490 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c0574e0a-ce4b-4b92-8350-0dcd13ef6f73 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1513 microversion: 2.1 time: 0.292650 Jul 01 07:13:29.771528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 293/577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:29 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:29.781707 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-75050e99-4f71-4ace-b039-f90ad9b163d9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:29.782347 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-75050e99-4f71-4ace-b039-f90ad9b163d9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:29.789268 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-75050e99-4f71-4ace-b039-f90ad9b163d9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.789816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-75050e99-4f71-4ace-b039-f90ad9b163d9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.790649 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-75050e99-4f71-4ace-b039-f90ad9b163d9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.791253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-75050e99-4f71-4ace-b039-f90ad9b163d9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.900753 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c4db8c7d-d431-4c88-b2f7-f07d7524ae39 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:29.908274 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c4db8c7d-d431-4c88-b2f7-f07d7524ae39 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.179842 Jul 01 07:13:29.908954 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 285/578] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:29 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:29.929435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-75050e99-4f71-4ace-b039-f90ad9b163d9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/action" status: 202 len: 0 microversion: 2.20 time: 0.151588 Jul 01 07:13:29.930077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 294/579] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jul 1 07:13:29 2022] POST /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 01 07:13:29.938215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:29.938837 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:29.945426 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.945865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:29.946619 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:29.947125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:30.105907 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:30.119779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:30.121395 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:30.122725 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cbde5b20-b642-4c10-86cf-3fb892ba26bb tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1752 microversion: 2.20 time: 0.188614 Jul 01 07:13:30.123485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 286/580] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:29 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:30.787909 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-300ea569-ddaa-430a-965e-fcd73f78bac0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:30.789178 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-300ea569-ddaa-430a-965e-fcd73f78bac0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:30.796142 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-300ea569-ddaa-430a-965e-fcd73f78bac0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:30.796888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-300ea569-ddaa-430a-965e-fcd73f78bac0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:30.797689 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-300ea569-ddaa-430a-965e-fcd73f78bac0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:30.798130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-300ea569-ddaa-430a-965e-fcd73f78bac0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:30.926284 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-dc0bf072-9bff-44fb-8c82-e01a43fdb945 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:30.926969 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-dc0bf072-9bff-44fb-8c82-e01a43fdb945 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:30.933898 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc0bf072-9bff-44fb-8c82-e01a43fdb945 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:30.934685 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc0bf072-9bff-44fb-8c82-e01a43fdb945 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:30.935533 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc0bf072-9bff-44fb-8c82-e01a43fdb945 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:30.935969 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc0bf072-9bff-44fb-8c82-e01a43fdb945 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:31.300815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-300ea569-ddaa-430a-965e-fcd73f78bac0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:31.309467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-300ea569-ddaa-430a-965e-fcd73f78bac0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1513 microversion: 2.1 time: 0.525640 Jul 01 07:13:31.310130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 295/581] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:30 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1513 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:31.354271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-dc0bf072-9bff-44fb-8c82-e01a43fdb945 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:31.365395 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-dc0bf072-9bff-44fb-8c82-e01a43fdb945 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.443704 Jul 01 07:13:31.368803 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 287/582] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:30 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:31.464728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-b41247f6-d2bf-444e-8f1d-c8e02ba60b1a req-bc4a8d58-e228-40c5-a224-28269f2e3f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8656e950-5648-4618-8903-c7a23f9f5c46", "name": "network-vif-deleted", "tag": "6a129c25-2d7b-4f7c-a0bc-1a8297081bea"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:31.473464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-b41247f6-d2bf-444e-8f1d-c8e02ba60b1a req-bc4a8d58-e228-40c5-a224-28269f2e3f3b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:31.473831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-b41247f6-d2bf-444e-8f1d-c8e02ba60b1a req-bc4a8d58-e228-40c5-a224-28269f2e3f3b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:31.485195 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-b41247f6-d2bf-444e-8f1d-c8e02ba60b1a req-bc4a8d58-e228-40c5-a224-28269f2e3f3b service nova] Creating event network-vif-deleted:6a129c25-2d7b-4f7c-a0bc-1a8297081bea for instance 8656e950-5648-4618-8903-c7a23f9f5c46 on hv-cinder-80721 Jul 01 07:13:31.490259 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-b41247f6-d2bf-444e-8f1d-c8e02ba60b1a req-bc4a8d58-e228-40c5-a224-28269f2e3f3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029079 Jul 01 07:13:31.491033 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 288/583] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:13:31.498376 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:31.499011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:31.505021 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:31.505465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:31.506224 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:31.506653 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:31.641122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:31.650315 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:31.651940 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:31.653152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-aca91ed8-aead-4bd5-9a45-163133ae5c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1754 microversion: 2.20 time: 0.342235 Jul 01 07:13:31.653714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 296/584] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:31 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1754 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:32.327419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-90daa284-f063-48f4-8c3a-e4108e509c8b tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:32.328213 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-90daa284-f063-48f4-8c3a-e4108e509c8b tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:32.334527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-90daa284-f063-48f4-8c3a-e4108e509c8b tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:32.335014 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-90daa284-f063-48f4-8c3a-e4108e509c8b tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:32.335941 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-90daa284-f063-48f4-8c3a-e4108e509c8b tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:32.336375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-90daa284-f063-48f4-8c3a-e4108e509c8b tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:32.385241 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b6a9c226-2dff-4dbd-974d-3dac481c7f3d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:32.385959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b6a9c226-2dff-4dbd-974d-3dac481c7f3d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:32.392366 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b6a9c226-2dff-4dbd-974d-3dac481c7f3d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:32.392880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b6a9c226-2dff-4dbd-974d-3dac481c7f3d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:32.393724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b6a9c226-2dff-4dbd-974d-3dac481c7f3d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:32.394244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b6a9c226-2dff-4dbd-974d-3dac481c7f3d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:32.404791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-90daa284-f063-48f4-8c3a-e4108e509c8b tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:32.412574 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-90daa284-f063-48f4-8c3a-e4108e509c8b tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1303 microversion: 2.1 time: 0.089663 Jul 01 07:13:32.413047 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 289/585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:32 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:32.526350 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b6a9c226-2dff-4dbd-974d-3dac481c7f3d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:32.533734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b6a9c226-2dff-4dbd-974d-3dac481c7f3d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.152365 Jul 01 07:13:32.534290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 297/586] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:32 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:32.672290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:32.672905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:32.679552 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:32.680003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:32.680760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:32.681196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:32.804811 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:32.813650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:32.815180 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:32.816337 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8edac1b8-1c99-4d75-9777-e44bc2ce8dd1 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1754 microversion: 2.20 time: 0.147930 Jul 01 07:13:32.816893 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 290/587] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:32 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1754 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:33.428875 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8c52d805-0f83-4c79-8e17-81616fb338db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:33.429481 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8c52d805-0f83-4c79-8e17-81616fb338db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:33.436216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8c52d805-0f83-4c79-8e17-81616fb338db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:33.436662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8c52d805-0f83-4c79-8e17-81616fb338db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:33.437414 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8c52d805-0f83-4c79-8e17-81616fb338db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:33.437840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8c52d805-0f83-4c79-8e17-81616fb338db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:33.501035 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8c52d805-0f83-4c79-8e17-81616fb338db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:33.508885 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8c52d805-0f83-4c79-8e17-81616fb338db tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 200 len: 1303 microversion: 2.1 time: 0.083826 Jul 01 07:13:33.509436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 298/588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:33 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:33.550662 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-131e2d46-8285-42df-93aa-05393918a6d6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:33.551286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-131e2d46-8285-42df-93aa-05393918a6d6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:33.557678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-131e2d46-8285-42df-93aa-05393918a6d6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:33.558137 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-131e2d46-8285-42df-93aa-05393918a6d6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:33.558929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-131e2d46-8285-42df-93aa-05393918a6d6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:33.559633 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-131e2d46-8285-42df-93aa-05393918a6d6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:33.684713 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-131e2d46-8285-42df-93aa-05393918a6d6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:33.692694 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-131e2d46-8285-42df-93aa-05393918a6d6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.145833 Jul 01 07:13:33.693256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 291/589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:33 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:33.834222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:33.834787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:33.840712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:33.841157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:33.841906 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:33.842336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:33.968677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:33.977860 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:33.980150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:33.980873 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7ea5a2d9-d40c-4af8-9824-6c024f57b360 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1754 microversion: 2.20 time: 0.150590 Jul 01 07:13:33.981427 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 299/590] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:33 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:34.528670 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:34.529510 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 8656e950-5648-4618-8903-c7a23f9f5c46] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:34.536379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:34.536873 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:34.537698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:34.538445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:34.552413 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] HTTP exception thrown: Instance 8656e950-5648-4618-8903-c7a23f9f5c46 could not be found. Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Request method failure captured: Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 HTTP/1.1 Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp4Z-pBfPt7L96zaHWiTZe68D1Nl3A2SkdvAxXoXqN2GhEBBdpQM3XJHmucRJB4hch52PnaSxkyzKzy8T299I9QgVW9KtiDG6LfHtLl8x-nIZ2k0gVTp9Lhu5e1qLEjH7l3DqBMhcQrbh2BD6awNFc8a1SoKiLy9zBspf5nmPrUadLs Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: 6dd3241e9f134a7bb89bbaf40232959c Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1127969674 Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:13:34.554057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6dd3241e9f134a7bb89bbaf40232959c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6dd3241e9f134a7bb89bbaf40232959c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6dd3241e9f134a7bb89bbaf40232959c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6dd3241e9f134a7bb89bbaf40232959c"}]}] Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-VolumesSnapshotTestJSON-1127969674 Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 6dd3241e9f134a7bb89bbaf40232959c Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1127969674 Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-VolumesSnapshotTestJSON-1127969674-project Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 1957cb1501da480f9974bda730ce9db3 Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-VolumesSnapshotTestJSON-1127969674-project Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 8656e950-5648-4618-8903-c7a23f9f5c46 could not be found. Jul 01 07:13:34.555688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '8656e950-5648-4618-8903-c7a23f9f5c46'} Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8656e950-5648-4618-8903-c7a23f9f5c46 could not be found. Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:13:34.556576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8656e950-5648-4618-8903-c7a23f9f5c46 could not be found. Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8656e950-5648-4618-8903-c7a23f9f5c46 could not be found. Jul 01 07:13:34.558760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:13:34.560487 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Returning 404 to user: Instance 8656e950-5648-4618-8903-c7a23f9f5c46 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:13:34.560487 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f44338ce-0341-40b0-b18f-67c965d4e434 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46" status: 404 len: 111 microversion: 2.1 time: 0.032204 Jul 01 07:13:34.560487 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 292/591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:34 2022] GET /compute/v2.1/servers/8656e950-5648-4618-8903-c7a23f9f5c46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:13:34.710954 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-05b81ae3-56f5-47a6-a8db-38a24534db41 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:34.711653 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-05b81ae3-56f5-47a6-a8db-38a24534db41 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:34.718784 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-05b81ae3-56f5-47a6-a8db-38a24534db41 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:34.719332 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-05b81ae3-56f5-47a6-a8db-38a24534db41 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:34.720360 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-05b81ae3-56f5-47a6-a8db-38a24534db41 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:34.720870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-05b81ae3-56f5-47a6-a8db-38a24534db41 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:34.857638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-05b81ae3-56f5-47a6-a8db-38a24534db41 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:34.861200 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:34.866685 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-05b81ae3-56f5-47a6-a8db-38a24534db41 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.160851 Jul 01 07:13:34.867270 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 300/592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:34 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:35.000313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:35.000919 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:35.007410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:35.007856 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:35.008608 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:35.009039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:35.136809 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:35.145442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:35.146998 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:35.148167 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-843ce6e6-ce06-49fc-b427-5f73d82945ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.151730 Jul 01 07:13:35.148724 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 293/593] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:34 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:35.883968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-deba505d-4685-432f-ae3a-275c9ba4c9fb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:35.884576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-deba505d-4685-432f-ae3a-275c9ba4c9fb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:35.891814 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-deba505d-4685-432f-ae3a-275c9ba4c9fb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:35.892265 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-deba505d-4685-432f-ae3a-275c9ba4c9fb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:35.893027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-deba505d-4685-432f-ae3a-275c9ba4c9fb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:35.893463 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-deba505d-4685-432f-ae3a-275c9ba4c9fb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:36.018224 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-deba505d-4685-432f-ae3a-275c9ba4c9fb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:36.026102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-deba505d-4685-432f-ae3a-275c9ba4c9fb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.146801 Jul 01 07:13:36.026659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 301/594] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:35 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:36.166678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:36.167314 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:36.173876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:36.174319 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:36.175125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:36.175564 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:36.301637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:36.310205 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:36.311739 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:36.312893 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fba666fd-6a91-45af-9a85-99f1b9632aaf tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.150130 Jul 01 07:13:36.313448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 294/595] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:36 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:37.043708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4225498d-2f2e-4608-8b11-b570a167cab8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:37.044327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4225498d-2f2e-4608-8b11-b570a167cab8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:37.050622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4225498d-2f2e-4608-8b11-b570a167cab8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:37.051141 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4225498d-2f2e-4608-8b11-b570a167cab8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:37.051920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4225498d-2f2e-4608-8b11-b570a167cab8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:37.052365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4225498d-2f2e-4608-8b11-b570a167cab8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:37.188818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4225498d-2f2e-4608-8b11-b570a167cab8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:37.196800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4225498d-2f2e-4608-8b11-b570a167cab8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.156960 Jul 01 07:13:37.197370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 302/596] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:37 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:37.331997 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:37.332531 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:37.339273 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:37.339716 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:37.340469 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:37.340902 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:37.466305 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:37.474645 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:37.477106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:37.478333 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2a2874f3-65ec-429d-8b01-6ef07de1bd71 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.150922 Jul 01 07:13:37.479118 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 295/597] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:37 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:38.213769 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c4bd5b89-a315-4898-9362-ddaa17e71ca8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:38.214148 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c4bd5b89-a315-4898-9362-ddaa17e71ca8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:38.220404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4bd5b89-a315-4898-9362-ddaa17e71ca8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:38.220852 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4bd5b89-a315-4898-9362-ddaa17e71ca8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:38.221614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4bd5b89-a315-4898-9362-ddaa17e71ca8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:38.222706 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c4bd5b89-a315-4898-9362-ddaa17e71ca8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:38.347964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c4bd5b89-a315-4898-9362-ddaa17e71ca8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:38.355276 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c4bd5b89-a315-4898-9362-ddaa17e71ca8 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.145820 Jul 01 07:13:38.355835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 303/598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:38 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:38.500220 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:38.500771 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:38.507189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:38.507639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:38.508396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:38.508828 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:38.640024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:38.657173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:38.658937 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:38.660069 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c8086ca7-9b91-4ccf-8d7d-f2a0d9878d2d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.166990 Jul 01 07:13:38.660635 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 296/599] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:38 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:39.372526 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e600518b-6550-4322-a59f-bed5f6675ca1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:39.373250 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e600518b-6550-4322-a59f-bed5f6675ca1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:39.380445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e600518b-6550-4322-a59f-bed5f6675ca1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:39.380798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e600518b-6550-4322-a59f-bed5f6675ca1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:39.381572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e600518b-6550-4322-a59f-bed5f6675ca1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:39.382010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e600518b-6550-4322-a59f-bed5f6675ca1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:39.511930 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e600518b-6550-4322-a59f-bed5f6675ca1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:39.519337 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e600518b-6550-4322-a59f-bed5f6675ca1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.150762 Jul 01 07:13:39.519882 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 304/600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:39 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:39.680371 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:39.681250 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:39.689174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:39.689762 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:39.690986 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:39.691709 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:39.845083 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:39.861190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:39.864204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:39.866913 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d5a6ef1a-9efd-4261-b3e1-b9f068025855 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.190375 Jul 01 07:13:39.868557 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 297/601] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:39 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:40.536069 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-76697202-3f4a-4721-b4d6-6d9b6327460f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:40.536717 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-76697202-3f4a-4721-b4d6-6d9b6327460f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:40.543257 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76697202-3f4a-4721-b4d6-6d9b6327460f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:40.543714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76697202-3f4a-4721-b4d6-6d9b6327460f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:40.544476 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76697202-3f4a-4721-b4d6-6d9b6327460f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:40.544912 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76697202-3f4a-4721-b4d6-6d9b6327460f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:40.686910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-76697202-3f4a-4721-b4d6-6d9b6327460f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:40.695322 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-76697202-3f4a-4721-b4d6-6d9b6327460f tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.163128 Jul 01 07:13:40.696203 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 305/602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:40 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:40.886125 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:40.886739 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:40.899162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:40.900693 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:40.907596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:40.908110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:40.944218 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3da00449-7fd7-4e84-83ea-42fb1e718162 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd2fdb5a-07ba-43a3-bd52-df1f6512db2d"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:40.945587 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3da00449-7fd7-4e84-83ea-42fb1e718162 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:40.952878 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3da00449-7fd7-4e84-83ea-42fb1e718162 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:40.953508 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3da00449-7fd7-4e84-83ea-42fb1e718162 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:40.954644 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3da00449-7fd7-4e84-83ea-42fb1e718162 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:40.955457 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3da00449-7fd7-4e84-83ea-42fb1e718162 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:41.056030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:41.072086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:41.080915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:41.083104 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:41.084274 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a67f6fac-ed8d-4133-9911-d3818cc5d90b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.202073 Jul 01 07:13:41.084837 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 306/603] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:40 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:41.557313 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-6050729b-70f1-460a-970f-93986c0d5d85 req-4f139692-daa7-4efa-a23b-66e5db06aaca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a035c87f-f7c1-4663-babc-7e64de9f1718", "name": "network-vif-plugged", "status": "completed", "tag": "a0ad1989-7e46-4e7a-a4e2-e30646d4df95"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:41.579426 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-6050729b-70f1-460a-970f-93986c0d5d85 req-4f139692-daa7-4efa-a23b-66e5db06aaca service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:41.579865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-6050729b-70f1-460a-970f-93986c0d5d85 req-4f139692-daa7-4efa-a23b-66e5db06aaca service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:41.591406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-6050729b-70f1-460a-970f-93986c0d5d85 req-4f139692-daa7-4efa-a23b-66e5db06aaca service nova] Creating event network-vif-plugged:a0ad1989-7e46-4e7a-a4e2-e30646d4df95 for instance a035c87f-f7c1-4663-babc-7e64de9f1718 on hv-cinder-80721 Jul 01 07:13:41.597348 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-6050729b-70f1-460a-970f-93986c0d5d85 req-4f139692-daa7-4efa-a23b-66e5db06aaca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043087 Jul 01 07:13:41.597944 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 307/604] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:13:41.713165 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2b91b2fb-ed3f-4d04-835a-b3f830df4c32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:41.713910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2b91b2fb-ed3f-4d04-835a-b3f830df4c32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:41.720191 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b91b2fb-ed3f-4d04-835a-b3f830df4c32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:41.720635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b91b2fb-ed3f-4d04-835a-b3f830df4c32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:41.721385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b91b2fb-ed3f-4d04-835a-b3f830df4c32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:41.722360 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b91b2fb-ed3f-4d04-835a-b3f830df4c32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:41.848580 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2b91b2fb-ed3f-4d04-835a-b3f830df4c32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:41.855814 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2b91b2fb-ed3f-4d04-835a-b3f830df4c32 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.146863 Jul 01 07:13:41.856370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 308/605] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:41 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:42.102827 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:42.103444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:42.109341 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:42.109790 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:42.110542 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:42.110999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:42.266812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:42.276412 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:42.277917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:42.279130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fcfa3cd8-ffe2-438f-9062-6fd493e9ab9c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.180137 Jul 01 07:13:42.279684 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 309/606] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:42 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:42.875243 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-76f71ec3-28f0-40bf-8042-2ddd93cbc743 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:42.876309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-76f71ec3-28f0-40bf-8042-2ddd93cbc743 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:42.887667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76f71ec3-28f0-40bf-8042-2ddd93cbc743 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:42.888440 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76f71ec3-28f0-40bf-8042-2ddd93cbc743 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:42.889741 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76f71ec3-28f0-40bf-8042-2ddd93cbc743 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:42.890489 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-76f71ec3-28f0-40bf-8042-2ddd93cbc743 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:43.031292 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-76f71ec3-28f0-40bf-8042-2ddd93cbc743 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:43.039489 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-76f71ec3-28f0-40bf-8042-2ddd93cbc743 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.169983 Jul 01 07:13:43.040075 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 310/607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:42 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:43.297363 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:43.297976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:43.303984 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:43.304429 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:43.305184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:43.305622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:43.431457 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:43.440093 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:43.442259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:43.443449 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f3128269-dd63-48c0-bfae-325cb7d37b9b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.150001 Jul 01 07:13:43.444001 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 311/608] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:43 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:44.056821 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8612797e-9fcd-4492-b346-96ff60900c52 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:44.057503 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8612797e-9fcd-4492-b346-96ff60900c52 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:44.064200 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8612797e-9fcd-4492-b346-96ff60900c52 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:44.064657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8612797e-9fcd-4492-b346-96ff60900c52 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:44.065485 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8612797e-9fcd-4492-b346-96ff60900c52 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:44.065905 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8612797e-9fcd-4492-b346-96ff60900c52 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:44.214659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8612797e-9fcd-4492-b346-96ff60900c52 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:44.223431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8612797e-9fcd-4492-b346-96ff60900c52 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.170011 Jul 01 07:13:44.224298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 312/609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:44 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:44.461975 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:44.462584 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:44.468729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:44.469181 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:44.469955 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:44.470425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:44.608643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:44.617217 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:44.618731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:44.619936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-46318ed5-9200-4342-a4c2-35b38302af63 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.161884 Jul 01 07:13:44.620498 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 313/610] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:44 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:45.239948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e1692319-7a18-47aa-98d4-7b7a7439ffc3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:45.240580 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e1692319-7a18-47aa-98d4-7b7a7439ffc3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:45.247224 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1692319-7a18-47aa-98d4-7b7a7439ffc3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:45.247673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1692319-7a18-47aa-98d4-7b7a7439ffc3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:45.248435 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1692319-7a18-47aa-98d4-7b7a7439ffc3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:45.248871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e1692319-7a18-47aa-98d4-7b7a7439ffc3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:45.388386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e1692319-7a18-47aa-98d4-7b7a7439ffc3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:45.396336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e1692319-7a18-47aa-98d4-7b7a7439ffc3 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.160704 Jul 01 07:13:45.396915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 314/611] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:45 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:45.639086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:45.640139 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:45.646561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:45.647140 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:45.648006 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:45.648511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:45.796524 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:45.805725 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:45.807318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:45.808545 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-901c5993-2bfc-4238-9c2b-74f0fde5a30c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.173362 Jul 01 07:13:45.809767 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 315/612] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:45 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:46.413362 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d797136d-1521-4bbb-ba32-6bd0e841ba27 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:46.414198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d797136d-1521-4bbb-ba32-6bd0e841ba27 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:46.421174 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d797136d-1521-4bbb-ba32-6bd0e841ba27 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:46.421627 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d797136d-1521-4bbb-ba32-6bd0e841ba27 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:46.422434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d797136d-1521-4bbb-ba32-6bd0e841ba27 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:46.422897 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d797136d-1521-4bbb-ba32-6bd0e841ba27 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:46.567140 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d797136d-1521-4bbb-ba32-6bd0e841ba27 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:46.574479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d797136d-1521-4bbb-ba32-6bd0e841ba27 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.165013 Jul 01 07:13:46.575076 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 316/613] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:46 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:46.826318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:46.826902 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:46.832724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:46.833174 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:46.833934 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:46.834368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:46.967525 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:46.977873 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:46.979480 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:46.980650 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1d1554a4-eb8d-45cb-89be-ba026a3cd012 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.158238 Jul 01 07:13:46.981218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 317/614] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:46 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:47.590940 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-83f61dcc-2290-411d-8036-2038c08a06fd tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:47.591575 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-83f61dcc-2290-411d-8036-2038c08a06fd tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:47.597963 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-83f61dcc-2290-411d-8036-2038c08a06fd tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:47.598414 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-83f61dcc-2290-411d-8036-2038c08a06fd tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:47.599228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-83f61dcc-2290-411d-8036-2038c08a06fd tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:47.599665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-83f61dcc-2290-411d-8036-2038c08a06fd tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:47.603693 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:47.723670 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-83f61dcc-2290-411d-8036-2038c08a06fd tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:47.730903 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-83f61dcc-2290-411d-8036-2038c08a06fd tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.143733 Jul 01 07:13:47.731464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 318/615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:47 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:47.999029 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:47.999565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:48.006459 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:48.006952 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:48.007718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:48.008182 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:48.147306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:48.156139 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:48.157807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:48.159793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c847c5f9-5687-413d-9706-3ef844f2c154 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.164082 Jul 01 07:13:48.166936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 319/616] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:47 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:48.618647 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1067632611", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "networks": [{"uuid": "0be3a606-8ed5-49e6-be40-ef0af9b5225b"}]}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:13:48.671394 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] validate_networks() for [('0be3a606-8ed5-49e6-be40-ef0af9b5225b', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:13:49.028288 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:13:49.028712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:13:49.029202 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:13:49.029712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:13:49.030190 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:13:49.039600 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:49.040041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:49.040828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:49.041253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:49.057615 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Getting quotas for project 6dd3241e9f134a7bb89bbaf40232959c. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:13:49.061944 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Getting quotas for user 1957cb1501da480f9974bda730ce9db3 and project 6dd3241e9f134a7bb89bbaf40232959c. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:13:49.073922 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:13:49.076289 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:13:49.126000 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9e38f6b9-9cae-4828-9335-3f5abc25bb93 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511263 Jul 01 07:13:49.126648 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 320/617] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 07:13:49.131451 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8d5fa438-b4bb-45f2-9da4-6e2bda3f7d88 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:49.132072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8d5fa438-b4bb-45f2-9da4-6e2bda3f7d88 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:49.133897 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:49.139249 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d5fa438-b4bb-45f2-9da4-6e2bda3f7d88 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:49.139701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d5fa438-b4bb-45f2-9da4-6e2bda3f7d88 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:49.140479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d5fa438-b4bb-45f2-9da4-6e2bda3f7d88 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:49.140918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d5fa438-b4bb-45f2-9da4-6e2bda3f7d88 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:49.299600 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8d5fa438-b4bb-45f2-9da4-6e2bda3f7d88 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:49.309482 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8d5fa438-b4bb-45f2-9da4-6e2bda3f7d88 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.181424 Jul 01 07:13:49.309987 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 321/618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:49 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:49.314410 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f2dcc5f8-ddde-44ed-906a-480402866108 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:49.315075 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f2dcc5f8-ddde-44ed-906a-480402866108 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:49.397497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f2dcc5f8-ddde-44ed-906a-480402866108 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:49.412235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f2dcc5f8-ddde-44ed-906a-480402866108 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1219 microversion: 2.1 time: 0.101047 Jul 01 07:13:49.413231 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 322/619] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:49 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:49.418135 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:49.418932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:49.427301 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:49.427843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:49.428963 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:49.429417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:49.564189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:49.576076 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:49.577514 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:49.578734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5813485e-e138-41e6-aa19-340c5718f191 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.164518 Jul 01 07:13:49.579679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 323/620] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:49 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:50.325869 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-23b15528-f336-4dd6-8177-3f46dba004e9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:50.326546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-23b15528-f336-4dd6-8177-3f46dba004e9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:50.333559 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-23b15528-f336-4dd6-8177-3f46dba004e9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:50.334015 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-23b15528-f336-4dd6-8177-3f46dba004e9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:50.334808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-23b15528-f336-4dd6-8177-3f46dba004e9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:50.335258 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-23b15528-f336-4dd6-8177-3f46dba004e9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:50.481871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-23b15528-f336-4dd6-8177-3f46dba004e9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:50.489729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-23b15528-f336-4dd6-8177-3f46dba004e9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.167800 Jul 01 07:13:50.490289 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 324/621] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:50 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:50.494565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-38edf33f-be88-491b-885f-240bd612f8c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:50.495191 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-38edf33f-be88-491b-885f-240bd612f8c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:50.500727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-38edf33f-be88-491b-885f-240bd612f8c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:50.501176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-38edf33f-be88-491b-885f-240bd612f8c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:50.501933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-38edf33f-be88-491b-885f-240bd612f8c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:50.502373 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-38edf33f-be88-491b-885f-240bd612f8c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:50.569928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-38edf33f-be88-491b-885f-240bd612f8c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:50.578591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-38edf33f-be88-491b-885f-240bd612f8c3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1223 microversion: 2.1 time: 0.087185 Jul 01 07:13:50.579176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 325/622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:50 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:50.599117 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:50.599721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:50.605780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:50.606222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:50.607020 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:50.607447 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:50.757731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:50.766249 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:50.767824 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:50.768973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0a4c9bdb-c12b-43ab-a551-c13c4fd0bc95 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.174222 Jul 01 07:13:50.769533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 326/623] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:50 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:50.952357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=61 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:51.075340 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:51.507751 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fc39ba37-2243-4aca-839c-37c73ea1308e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:51.508493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fc39ba37-2243-4aca-839c-37c73ea1308e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:51.515459 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fc39ba37-2243-4aca-839c-37c73ea1308e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:51.516099 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fc39ba37-2243-4aca-839c-37c73ea1308e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:51.516916 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fc39ba37-2243-4aca-839c-37c73ea1308e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:51.517340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fc39ba37-2243-4aca-839c-37c73ea1308e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:51.653213 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fc39ba37-2243-4aca-839c-37c73ea1308e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:51.660642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fc39ba37-2243-4aca-839c-37c73ea1308e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.157813 Jul 01 07:13:51.661282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 327/624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:51 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:51.665744 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-caa1db08-dbc5-4557-89d6-96a29f85e450 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:51.666402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-caa1db08-dbc5-4557-89d6-96a29f85e450 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:51.672415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-caa1db08-dbc5-4557-89d6-96a29f85e450 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:51.672877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-caa1db08-dbc5-4557-89d6-96a29f85e450 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:51.673923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-caa1db08-dbc5-4557-89d6-96a29f85e450 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:51.674442 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-caa1db08-dbc5-4557-89d6-96a29f85e450 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:51.742889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-caa1db08-dbc5-4557-89d6-96a29f85e450 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:51.750526 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-caa1db08-dbc5-4557-89d6-96a29f85e450 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1223 microversion: 2.1 time: 0.088234 Jul 01 07:13:51.751159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 328/625] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:51 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:51.786763 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:51.787339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:51.797888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:51.798698 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:51.800045 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:51.801019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:51.949553 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:51.959216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:51.961423 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:51.963103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e4acd6fe-417d-44df-b1a9-967a8c1ad13e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.179939 Jul 01 07:13:51.963919 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 329/626] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:51 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:52.677402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5a98e578-e16a-422a-8d43-ea88ffe130d5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:52.678146 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5a98e578-e16a-422a-8d43-ea88ffe130d5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:52.684889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a98e578-e16a-422a-8d43-ea88ffe130d5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:52.685340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a98e578-e16a-422a-8d43-ea88ffe130d5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:52.686113 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a98e578-e16a-422a-8d43-ea88ffe130d5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:52.686545 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a98e578-e16a-422a-8d43-ea88ffe130d5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:52.823950 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5a98e578-e16a-422a-8d43-ea88ffe130d5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:52.831661 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5a98e578-e16a-422a-8d43-ea88ffe130d5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.158061 Jul 01 07:13:52.832758 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 330/627] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:52 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:52.837240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e522815d-0a22-4d06-bcdd-7900a02c574f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:52.837845 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e522815d-0a22-4d06-bcdd-7900a02c574f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:52.843972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e522815d-0a22-4d06-bcdd-7900a02c574f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:52.844424 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e522815d-0a22-4d06-bcdd-7900a02c574f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:52.845191 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e522815d-0a22-4d06-bcdd-7900a02c574f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:52.845629 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e522815d-0a22-4d06-bcdd-7900a02c574f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:52.912472 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e522815d-0a22-4d06-bcdd-7900a02c574f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:52.920113 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e522815d-0a22-4d06-bcdd-7900a02c574f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1223 microversion: 2.1 time: 0.086328 Jul 01 07:13:52.921025 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 331/628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:52 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:52.980988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:52.981580 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:52.987692 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:52.988713 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:52.989474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:52.989908 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:53.137263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:53.147542 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:53.149055 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:53.150228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b68c2022-7e7e-4b79-aa20-5930d49637aa tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.173182 Jul 01 07:13:53.150800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 332/629] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:52 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:53.849017 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bdb4919b-e8ce-44d5-92f3-befffc2f02c9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:53.849721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bdb4919b-e8ce-44d5-92f3-befffc2f02c9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:53.856181 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bdb4919b-e8ce-44d5-92f3-befffc2f02c9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:53.856629 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bdb4919b-e8ce-44d5-92f3-befffc2f02c9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:53.857424 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bdb4919b-e8ce-44d5-92f3-befffc2f02c9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:53.857862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bdb4919b-e8ce-44d5-92f3-befffc2f02c9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:53.985410 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-bdb4919b-e8ce-44d5-92f3-befffc2f02c9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:53.993292 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bdb4919b-e8ce-44d5-92f3-befffc2f02c9 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.148172 Jul 01 07:13:53.993849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 333/630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:53 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:53.998159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bd39bb91-1b05-40f9-b214-67d8447852e0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:53.998781 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bd39bb91-1b05-40f9-b214-67d8447852e0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:54.005073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bd39bb91-1b05-40f9-b214-67d8447852e0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:54.005518 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bd39bb91-1b05-40f9-b214-67d8447852e0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:54.006279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bd39bb91-1b05-40f9-b214-67d8447852e0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:54.006714 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bd39bb91-1b05-40f9-b214-67d8447852e0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:54.069175 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-bd39bb91-1b05-40f9-b214-67d8447852e0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:54.076644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bd39bb91-1b05-40f9-b214-67d8447852e0 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1223 microversion: 2.1 time: 0.081842 Jul 01 07:13:54.077220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 334/631] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:53 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:54.168923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:54.169635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:54.176254 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:54.176915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:54.178244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:54.179066 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:54.308428 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:54.317064 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:54.318493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:54.319665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9c4582fc-2e09-43bb-8eb8-82dbf9381c7a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.154542 Jul 01 07:13:54.320223 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 335/632] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:54 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:55.010905 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3185e4e3-cc76-4f40-a088-8cccf16d1981 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:55.011577 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3185e4e3-cc76-4f40-a088-8cccf16d1981 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:55.018087 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3185e4e3-cc76-4f40-a088-8cccf16d1981 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:55.018569 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3185e4e3-cc76-4f40-a088-8cccf16d1981 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:55.019336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3185e4e3-cc76-4f40-a088-8cccf16d1981 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:55.019769 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3185e4e3-cc76-4f40-a088-8cccf16d1981 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:55.039320 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:55.145634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3185e4e3-cc76-4f40-a088-8cccf16d1981 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:55.152887 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3185e4e3-cc76-4f40-a088-8cccf16d1981 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.145874 Jul 01 07:13:55.153456 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 336/633] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:55 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:55.157720 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-eb288a71-7f06-426d-8e33-23da50fa27c4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:55.158321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-eb288a71-7f06-426d-8e33-23da50fa27c4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:55.164287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eb288a71-7f06-426d-8e33-23da50fa27c4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:55.164799 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eb288a71-7f06-426d-8e33-23da50fa27c4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:55.165552 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eb288a71-7f06-426d-8e33-23da50fa27c4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:55.165988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eb288a71-7f06-426d-8e33-23da50fa27c4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:55.231396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-eb288a71-7f06-426d-8e33-23da50fa27c4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:55.239648 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-eb288a71-7f06-426d-8e33-23da50fa27c4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1223 microversion: 2.1 time: 0.085233 Jul 01 07:13:55.240244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 337/634] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:55 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:55.337122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:55.337662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:55.343527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:55.343982 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:55.344745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:55.345184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:55.471768 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:55.480820 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:55.482321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:55.483515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f560eed7-c2c7-4327-8204-6e96a15d088a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.150098 Jul 01 07:13:55.484067 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 338/635] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:55 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:13:55.807189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3da00449-7fd7-4e84-83ea-42fb1e718162 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.977952 Jul 01 07:13:55.807932 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 298/636] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:13:40 2022] POST /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments => generated 194 bytes in 14980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:13:56.170004 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ee7a64c1-1c64-42ac-b9e5-bfe823bf250b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:56.170611 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ee7a64c1-1c64-42ac-b9e5-bfe823bf250b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:56.177750 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ee7a64c1-1c64-42ac-b9e5-bfe823bf250b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:56.178192 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ee7a64c1-1c64-42ac-b9e5-bfe823bf250b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:56.179013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ee7a64c1-1c64-42ac-b9e5-bfe823bf250b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:56.179446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ee7a64c1-1c64-42ac-b9e5-bfe823bf250b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:56.258710 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5d3dcaf4-1bd7-4fed-a402-8a6a991bf5ad tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:56.259438 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5d3dcaf4-1bd7-4fed-a402-8a6a991bf5ad tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:56.265981 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5d3dcaf4-1bd7-4fed-a402-8a6a991bf5ad tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:56.266437 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5d3dcaf4-1bd7-4fed-a402-8a6a991bf5ad tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:56.267240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5d3dcaf4-1bd7-4fed-a402-8a6a991bf5ad tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:56.267682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5d3dcaf4-1bd7-4fed-a402-8a6a991bf5ad tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:56.314675 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ee7a64c1-1c64-42ac-b9e5-bfe823bf250b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:56.322728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ee7a64c1-1c64-42ac-b9e5-bfe823bf250b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.156565 Jul 01 07:13:56.323327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 339/637] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:56 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:56.333733 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5d3dcaf4-1bd7-4fed-a402-8a6a991bf5ad tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:56.341083 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5d3dcaf4-1bd7-4fed-a402-8a6a991bf5ad tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1215 microversion: 2.1 time: 0.087386 Jul 01 07:13:56.341631 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 299/638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:56 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:56.501356 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:56.501885 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:56.508420 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:56.508871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:56.509637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:56.510071 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:56.634884 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:56.643628 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:56.645118 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:56.646261 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3f013414-7946-405c-acf2-35a708ccf58f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.148884 Jul 01 07:13:56.646828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 340/639] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:56 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:57.338430 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-54eb3a22-df73-4463-8240-207588001504 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:57.339101 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-54eb3a22-df73-4463-8240-207588001504 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:57.345606 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-54eb3a22-df73-4463-8240-207588001504 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:57.346174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-54eb3a22-df73-4463-8240-207588001504 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:57.346989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-54eb3a22-df73-4463-8240-207588001504 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:57.347434 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-54eb3a22-df73-4463-8240-207588001504 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:57.357952 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5a22b39f-0750-425a-a825-4cddd824604a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:57.358564 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5a22b39f-0750-425a-a825-4cddd824604a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:57.365576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a22b39f-0750-425a-a825-4cddd824604a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:57.366030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a22b39f-0750-425a-a825-4cddd824604a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:57.366817 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a22b39f-0750-425a-a825-4cddd824604a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:57.367259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a22b39f-0750-425a-a825-4cddd824604a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:57.472663 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5a22b39f-0750-425a-a825-4cddd824604a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:57.480367 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5a22b39f-0750-425a-a825-4cddd824604a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1215 microversion: 2.1 time: 0.126416 Jul 01 07:13:57.481091 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 341/640] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:57 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:57.537139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-54eb3a22-df73-4463-8240-207588001504 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:57.544682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-54eb3a22-df73-4463-8240-207588001504 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.209783 Jul 01 07:13:57.545246 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 300/641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:57 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:57.664216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:57.664873 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:57.670835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:57.671293 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:57.672032 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:57.672460 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:57.799290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:57.808150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:57.809921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:57.811101 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6dd6633a-fa87-4193-a101-12721b1f853a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.150753 Jul 01 07:13:57.811666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 342/642] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:57 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:58.497381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ffcc9cc3-99aa-4e7d-baed-3a85bbbaaeef tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:58.497921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ffcc9cc3-99aa-4e7d-baed-3a85bbbaaeef tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:58.504423 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffcc9cc3-99aa-4e7d-baed-3a85bbbaaeef tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:58.504874 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffcc9cc3-99aa-4e7d-baed-3a85bbbaaeef tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:58.505630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffcc9cc3-99aa-4e7d-baed-3a85bbbaaeef tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:58.506068 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffcc9cc3-99aa-4e7d-baed-3a85bbbaaeef tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:58.564830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e2328c85-362d-49f6-bcad-719a01f20930 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:58.565433 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e2328c85-362d-49f6-bcad-719a01f20930 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:58.569239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ffcc9cc3-99aa-4e7d-baed-3a85bbbaaeef tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:58.572196 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e2328c85-362d-49f6-bcad-719a01f20930 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:58.572642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e2328c85-362d-49f6-bcad-719a01f20930 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:58.573408 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e2328c85-362d-49f6-bcad-719a01f20930 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:58.573868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e2328c85-362d-49f6-bcad-719a01f20930 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:58.579074 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ffcc9cc3-99aa-4e7d-baed-3a85bbbaaeef tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1271 microversion: 2.1 time: 0.084903 Jul 01 07:13:58.579074 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 301/643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:58 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:58.703323 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e2328c85-362d-49f6-bcad-719a01f20930 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:58.711134 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e2328c85-362d-49f6-bcad-719a01f20930 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.150106 Jul 01 07:13:58.711696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 343/644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:58 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:13:58.829984 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:58.830509 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:58.837102 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:58.837545 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:58.838292 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:58.838733 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:58.962804 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:58.971819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:58.973316 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:58.974467 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4c428727-220a-4d62-8d97-178e31a29929 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.148419 Jul 01 07:13:58.975054 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 302/645] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:58 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:13:59.595778 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a1e19c07-bd79-4cc6-9f8a-6fd56d035442 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:59.596382 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a1e19c07-bd79-4cc6-9f8a-6fd56d035442 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:59.598671 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:59.599426 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=8 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:13:59.605674 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a1e19c07-bd79-4cc6-9f8a-6fd56d035442 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:59.606115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a1e19c07-bd79-4cc6-9f8a-6fd56d035442 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:59.606903 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a1e19c07-bd79-4cc6-9f8a-6fd56d035442 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:59.607333 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a1e19c07-bd79-4cc6-9f8a-6fd56d035442 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:59.667149 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a1e19c07-bd79-4cc6-9f8a-6fd56d035442 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:13:59.674335 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a1e19c07-bd79-4cc6-9f8a-6fd56d035442 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1289 microversion: 2.1 time: 0.082385 Jul 01 07:13:59.674917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 344/646] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:59 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:13:59.728685 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4b7bb779-d37d-45dd-8b08-069c09376219 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:59.729224 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4b7bb779-d37d-45dd-8b08-069c09376219 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:59.735653 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4b7bb779-d37d-45dd-8b08-069c09376219 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:59.736103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4b7bb779-d37d-45dd-8b08-069c09376219 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:59.736866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4b7bb779-d37d-45dd-8b08-069c09376219 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:13:59.737303 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4b7bb779-d37d-45dd-8b08-069c09376219 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:13:59.992901 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:13:59.993436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:13:59.999651 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:00.000073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:00.000849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:00.001290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:00.095750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4b7bb779-d37d-45dd-8b08-069c09376219 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:00.103739 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4b7bb779-d37d-45dd-8b08-069c09376219 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1358 microversion: 2.1 time: 0.378940 Jul 01 07:14:00.104333 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 303/647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:13:59 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:00.176021 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:00.184561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:00.186077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:00.187238 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-27807538-0aa1-4438-86eb-b4c70776133e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.198400 Jul 01 07:14:00.187786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 345/648] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:13:59 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:14:00.693066 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a7a21c88-201c-4f23-a36d-0837e80e58b3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:00.693673 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a7a21c88-201c-4f23-a36d-0837e80e58b3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:00.699588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a7a21c88-201c-4f23-a36d-0837e80e58b3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:00.700037 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a7a21c88-201c-4f23-a36d-0837e80e58b3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:00.700800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a7a21c88-201c-4f23-a36d-0837e80e58b3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:00.701271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a7a21c88-201c-4f23-a36d-0837e80e58b3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:00.788108 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a7a21c88-201c-4f23-a36d-0837e80e58b3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:00.795652 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a7a21c88-201c-4f23-a36d-0837e80e58b3 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1277 microversion: 2.1 time: 0.107138 Jul 01 07:14:00.796419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 304/649] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:00 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:01.120305 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-45638107-1e5e-4295-a40f-e912e11fc770 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:01.120919 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-45638107-1e5e-4295-a40f-e912e11fc770 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:01.127448 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45638107-1e5e-4295-a40f-e912e11fc770 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.127840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45638107-1e5e-4295-a40f-e912e11fc770 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.128638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45638107-1e5e-4295-a40f-e912e11fc770 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.129075 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-45638107-1e5e-4295-a40f-e912e11fc770 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.208009 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:01.208652 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:01.214957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.215413 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.216216 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.216658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.266163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-45638107-1e5e-4295-a40f-e912e11fc770 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:01.273858 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-45638107-1e5e-4295-a40f-e912e11fc770 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1548 microversion: 2.1 time: 0.157346 Jul 01 07:14:01.274470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 346/650] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:01 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:01.290363 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5199be3f-3d9c-438e-b36b-cea9bfc8378c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:01.291008 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5199be3f-3d9c-438e-b36b-cea9bfc8378c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:01.296961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5199be3f-3d9c-438e-b36b-cea9bfc8378c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.297414 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5199be3f-3d9c-438e-b36b-cea9bfc8378c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.298187 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5199be3f-3d9c-438e-b36b-cea9bfc8378c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.298624 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5199be3f-3d9c-438e-b36b-cea9bfc8378c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.378297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:01.387339 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:01.388995 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:01.394977 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e539e5c4-ee44-4ba0-9d3d-f3fee891ecb8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.190815 Jul 01 07:14:01.405756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 305/651] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:01 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:14:01.500909 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5199be3f-3d9c-438e-b36b-cea9bfc8378c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:01.508518 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5199be3f-3d9c-438e-b36b-cea9bfc8378c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1548 microversion: 2.1 time: 0.221823 Jul 01 07:14:01.509090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 347/652] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:01 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:14:01.524780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:01.528437 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:01.529288 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Searching by: {'deleted': False, 'project_id': 'ce460f857d824071927f15e19cbb11e7'} {{(pid=117836) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 07:14:01.536616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.537149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.537955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.538401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.631991 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.multi_cell_list [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117836) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 07:14:01.734570 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4abc83b5-7f31-4739-8c35-f89f7fcb108c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213547 Jul 01 07:14:01.735283 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 306/653] 10.222.0.48 () {58 vars in 1124 bytes} [Fri Jul 1 07:14:01 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:01.745204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6b16540d-acaf-468b-9ca4-08b1947471c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:01.745816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6b16540d-acaf-468b-9ca4-08b1947471c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:01.751713 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6b16540d-acaf-468b-9ca4-08b1947471c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.752160 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6b16540d-acaf-468b-9ca4-08b1947471c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.752920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6b16540d-acaf-468b-9ca4-08b1947471c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.753972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6b16540d-acaf-468b-9ca4-08b1947471c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.813788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fb9c7e96-97fc-4106-84d1-3b76cacfbf83 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:01.814435 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fb9c7e96-97fc-4106-84d1-3b76cacfbf83 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:01.821015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fb9c7e96-97fc-4106-84d1-3b76cacfbf83 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.821473 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fb9c7e96-97fc-4106-84d1-3b76cacfbf83 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:01.822241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fb9c7e96-97fc-4106-84d1-3b76cacfbf83 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:01.822682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fb9c7e96-97fc-4106-84d1-3b76cacfbf83 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:02.048101 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6b16540d-acaf-468b-9ca4-08b1947471c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:02.055530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6b16540d-acaf-468b-9ca4-08b1947471c1 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1548 microversion: 2.1 time: 0.314097 Jul 01 07:14:02.056102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 348/654] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:01 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1548 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:02.091136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fb9c7e96-97fc-4106-84d1-3b76cacfbf83 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:02.099173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fb9c7e96-97fc-4106-84d1-3b76cacfbf83 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.289744 Jul 01 07:14:02.099943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 307/655] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:01 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:14:02.267737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-24a7c09b-6480-4fd5-9096-0c7fe0063df6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:02.270612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-24a7c09b-6480-4fd5-9096-0c7fe0063df6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:02.280321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24a7c09b-6480-4fd5-9096-0c7fe0063df6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:02.281263 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24a7c09b-6480-4fd5-9096-0c7fe0063df6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:02.282048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24a7c09b-6480-4fd5-9096-0c7fe0063df6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:02.282484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24a7c09b-6480-4fd5-9096-0c7fe0063df6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:02.317528 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-24a7c09b-6480-4fd5-9096-0c7fe0063df6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lazy-loading 'flavor' on Instance uuid 0c0721e7-9239-4832-b6dc-329e0682e8c6 {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:14:02.325571 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-4ded22e4-7bf9-4a45-81ac-e3a606859bd3 req-8483cee9-0608-44e7-93c7-2b8b523c4ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899a2250-e578-4353-811f-840463c59e28", "tag": "a88548af-22d8-48bd-8703-434c5dc976e5"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:02.334604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-4ded22e4-7bf9-4a45-81ac-e3a606859bd3 req-8483cee9-0608-44e7-93c7-2b8b523c4ca8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:02.335176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-4ded22e4-7bf9-4a45-81ac-e3a606859bd3 req-8483cee9-0608-44e7-93c7-2b8b523c4ca8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:02.346528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-4ded22e4-7bf9-4a45-81ac-e3a606859bd3 req-8483cee9-0608-44e7-93c7-2b8b523c4ca8 service nova] Creating event network-changed:a88548af-22d8-48bd-8703-434c5dc976e5 for instance 899a2250-e578-4353-811f-840463c59e28 on hv-cinder-80721 Jul 01 07:14:02.352578 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-4ded22e4-7bf9-4a45-81ac-e3a606859bd3 req-8483cee9-0608-44e7-93c7-2b8b523c4ca8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097008 Jul 01 07:14:02.353762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 349/656] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:02.413644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:02.414516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:02.421093 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:02.421833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:02.422883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:02.423504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:02.469627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-24a7c09b-6480-4fd5-9096-0c7fe0063df6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/action" status: 200 len: 32 microversion: 2.1 time: 0.213108 Jul 01 07:14:02.470446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 308/657] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:14:02 2022] POST /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:14:02.479896 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2899d5cb-26eb-4d4f-bd0f-109f5cf0fa6c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:02.480702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2899d5cb-26eb-4d4f-bd0f-109f5cf0fa6c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:02.488144 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2899d5cb-26eb-4d4f-bd0f-109f5cf0fa6c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:02.488603 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2899d5cb-26eb-4d4f-bd0f-109f5cf0fa6c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:02.490259 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2899d5cb-26eb-4d4f-bd0f-109f5cf0fa6c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:02.490711 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2899d5cb-26eb-4d4f-bd0f-109f5cf0fa6c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:02.651474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:02.660840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:02.662383 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:02.663641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fbfbe99e-d879-4843-9af8-53e768cba07a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.254706 Jul 01 07:14:02.664470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 350/658] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:02 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:02.693796 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2899d5cb-26eb-4d4f-bd0f-109f5cf0fa6c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:02.701739 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2899d5cb-26eb-4d4f-bd0f-109f5cf0fa6c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.226110 Jul 01 07:14:02.702334 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 309/659] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:02 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:03.115964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-123330cd-e46b-4d95-8689-628e30a85e08 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:03.116576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-123330cd-e46b-4d95-8689-628e30a85e08 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:03.122612 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-123330cd-e46b-4d95-8689-628e30a85e08 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:03.123090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-123330cd-e46b-4d95-8689-628e30a85e08 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:03.123847 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-123330cd-e46b-4d95-8689-628e30a85e08 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:03.124277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-123330cd-e46b-4d95-8689-628e30a85e08 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:03.262803 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-123330cd-e46b-4d95-8689-628e30a85e08 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:03.271306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-123330cd-e46b-4d95-8689-628e30a85e08 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.159159 Jul 01 07:14:03.271872 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 351/660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:03 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:03.641401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-25be0461-7a26-4a6a-84c7-686e12bacca6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a959c0ee-6bb4-45bd-bbe9-2e4583d680ae"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:03.642455 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-25be0461-7a26-4a6a-84c7-686e12bacca6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:03.649505 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-25be0461-7a26-4a6a-84c7-686e12bacca6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:03.649951 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-25be0461-7a26-4a6a-84c7-686e12bacca6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:03.650714 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-25be0461-7a26-4a6a-84c7-686e12bacca6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:03.651178 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-25be0461-7a26-4a6a-84c7-686e12bacca6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:03.682329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:03.683037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:03.689843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:03.690367 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:03.691850 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:03.692358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:03.819275 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:03.827577 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:03.829077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:03.830221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-57676675-ace1-400d-8014-0d7a4e9cce5e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.152110 Jul 01 07:14:03.830787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 352/661] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:03 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:14:03.835109 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-82612cd5-00ec-4dfc-9514-a4e3fba9b04f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:03.835711 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-82612cd5-00ec-4dfc-9514-a4e3fba9b04f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:03.841244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82612cd5-00ec-4dfc-9514-a4e3fba9b04f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:03.841693 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82612cd5-00ec-4dfc-9514-a4e3fba9b04f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:03.842454 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82612cd5-00ec-4dfc-9514-a4e3fba9b04f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:03.842927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-82612cd5-00ec-4dfc-9514-a4e3fba9b04f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:03.969103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-82612cd5-00ec-4dfc-9514-a4e3fba9b04f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:03.972560 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:03.978121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-82612cd5-00ec-4dfc-9514-a4e3fba9b04f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.146400 Jul 01 07:14:03.978680 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 353/662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:03 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:04.289656 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a8c692cd-554d-48d4-a899-ea12c931439e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:04.292553 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a8c692cd-554d-48d4-a899-ea12c931439e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:04.303889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a8c692cd-554d-48d4-a899-ea12c931439e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:04.304767 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a8c692cd-554d-48d4-a899-ea12c931439e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:04.306117 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a8c692cd-554d-48d4-a899-ea12c931439e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:04.306741 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a8c692cd-554d-48d4-a899-ea12c931439e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:04.399119 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:04.417443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-25be0461-7a26-4a6a-84c7-686e12bacca6 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "POST /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779898 Jul 01 07:14:04.418258 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 310/663] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:14:03 2022] POST /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:04.603462 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a8c692cd-554d-48d4-a899-ea12c931439e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:04.611005 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a8c692cd-554d-48d4-a899-ea12c931439e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.326816 Jul 01 07:14:04.611571 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 354/664] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:04 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:04.849459 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:04.850177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:04.856375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:04.856816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:04.857595 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:04.858026 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:04.982946 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:04.991295 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:04.992734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:04.993881 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8b42caf7-6d00-456d-9c77-8df1f8f647f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.149445 Jul 01 07:14:04.994429 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 311/665] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:04 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:04.996042 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d316c47b-63c4-4ce4-b7f6-dbcefb30b0e8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:04.996657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d316c47b-63c4-4ce4-b7f6-dbcefb30b0e8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:05.003944 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d316c47b-63c4-4ce4-b7f6-dbcefb30b0e8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:05.004398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d316c47b-63c4-4ce4-b7f6-dbcefb30b0e8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:05.005160 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d316c47b-63c4-4ce4-b7f6-dbcefb30b0e8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:05.005742 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d316c47b-63c4-4ce4-b7f6-dbcefb30b0e8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:05.134972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d316c47b-63c4-4ce4-b7f6-dbcefb30b0e8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:05.142805 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d316c47b-63c4-4ce4-b7f6-dbcefb30b0e8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.150664 Jul 01 07:14:05.143377 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 355/666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:04 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:14:05.628092 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-692f466f-a21d-4481-9ea8-4db6e45e3eb4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:05.628780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-692f466f-a21d-4481-9ea8-4db6e45e3eb4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:05.635955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-692f466f-a21d-4481-9ea8-4db6e45e3eb4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:05.636410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-692f466f-a21d-4481-9ea8-4db6e45e3eb4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:05.637179 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-692f466f-a21d-4481-9ea8-4db6e45e3eb4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:05.637618 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-692f466f-a21d-4481-9ea8-4db6e45e3eb4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:05.779444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-692f466f-a21d-4481-9ea8-4db6e45e3eb4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:05.786682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-692f466f-a21d-4481-9ea8-4db6e45e3eb4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.162438 Jul 01 07:14:05.787272 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 312/667] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:05 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:06.012865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:06.013404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:06.020571 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:06.021019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:06.021835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:06.022264 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:06.151829 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:06.161072 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2739947b-c1b3-4eef-95bf-c7591a379d60 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:06.161689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2739947b-c1b3-4eef-95bf-c7591a379d60 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:06.162244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:06.163803 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:06.164967 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9dc2dea0-6864-4105-bf38-b075555518ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.156121 Jul 01 07:14:06.165526 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 356/668] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:06 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:06.168034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2739947b-c1b3-4eef-95bf-c7591a379d60 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:06.168479 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2739947b-c1b3-4eef-95bf-c7591a379d60 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:06.169226 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2739947b-c1b3-4eef-95bf-c7591a379d60 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:06.169652 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2739947b-c1b3-4eef-95bf-c7591a379d60 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:06.299003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2739947b-c1b3-4eef-95bf-c7591a379d60 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:06.306891 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2739947b-c1b3-4eef-95bf-c7591a379d60 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.150171 Jul 01 07:14:06.307443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 313/669] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:06 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:14:06.803355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c64018af-be6d-488a-901a-c87690ff1b71 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:06.803965 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c64018af-be6d-488a-901a-c87690ff1b71 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:06.810430 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c64018af-be6d-488a-901a-c87690ff1b71 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:06.810865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c64018af-be6d-488a-901a-c87690ff1b71 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:06.811611 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c64018af-be6d-488a-901a-c87690ff1b71 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:06.812046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c64018af-be6d-488a-901a-c87690ff1b71 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:06.936375 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c64018af-be6d-488a-901a-c87690ff1b71 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:06.943687 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c64018af-be6d-488a-901a-c87690ff1b71 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.144226 Jul 01 07:14:06.944243 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 357/670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:06 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:07.183098 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:07.183701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:07.190567 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:07.191048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:07.192329 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:07.192765 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:07.323435 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:07.324021 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-cb69fb3c-585b-406d-939c-1fc0bc33f966 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:07.324634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-cb69fb3c-585b-406d-939c-1fc0bc33f966 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:07.330683 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cb69fb3c-585b-406d-939c-1fc0bc33f966 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:07.331159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cb69fb3c-585b-406d-939c-1fc0bc33f966 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:07.331923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cb69fb3c-585b-406d-939c-1fc0bc33f966 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:07.332995 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cb69fb3c-585b-406d-939c-1fc0bc33f966 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:07.333263 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:07.334855 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:07.336099 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-919a6039-eb84-4e92-bd6e-a6d3c0e317f6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.156867 Jul 01 07:14:07.336864 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 314/671] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:07 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:07.461914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-cb69fb3c-585b-406d-939c-1fc0bc33f966 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:07.469895 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-cb69fb3c-585b-406d-939c-1fc0bc33f966 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.149660 Jul 01 07:14:07.470452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 358/672] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:07 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:14:07.808611 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-d227602b-c12f-4de9-8fd5-84b3737f7380 req-f9a58c2a-d9e1-4e22-b187-e87f7d97d9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e3db32-ed35-4c27-ad2f-30bfbe556c25", "name": "network-vif-plugged", "status": "completed", "tag": "37b4518e-4b3f-4f6d-9030-a07d10ba59c5"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:07.817041 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-d227602b-c12f-4de9-8fd5-84b3737f7380 req-f9a58c2a-d9e1-4e22-b187-e87f7d97d9bf service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:07.817484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-d227602b-c12f-4de9-8fd5-84b3737f7380 req-f9a58c2a-d9e1-4e22-b187-e87f7d97d9bf service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:07.828552 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-d227602b-c12f-4de9-8fd5-84b3737f7380 req-f9a58c2a-d9e1-4e22-b187-e87f7d97d9bf service nova] Creating event network-vif-plugged:37b4518e-4b3f-4f6d-9030-a07d10ba59c5 for instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 on hv-cinder-80721 Jul 01 07:14:07.833218 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-d227602b-c12f-4de9-8fd5-84b3737f7380 req-f9a58c2a-d9e1-4e22-b187-e87f7d97d9bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028223 Jul 01 07:14:07.833800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 315/673] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:07.959497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ec340afc-ea69-418d-a80f-862bc2c51e06 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:07.960121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ec340afc-ea69-418d-a80f-862bc2c51e06 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:07.966661 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ec340afc-ea69-418d-a80f-862bc2c51e06 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:07.967150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ec340afc-ea69-418d-a80f-862bc2c51e06 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:07.967921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ec340afc-ea69-418d-a80f-862bc2c51e06 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:07.968361 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ec340afc-ea69-418d-a80f-862bc2c51e06 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:08.167507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ec340afc-ea69-418d-a80f-862bc2c51e06 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:08.175402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ec340afc-ea69-418d-a80f-862bc2c51e06 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.219796 Jul 01 07:14:08.175961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 359/674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:07 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:08.354896 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:08.355634 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:08.361724 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:08.362168 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:08.362949 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:08.363379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:08.487013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-47e2c821-06ee-4aa7-baae-daf9825de12f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:08.487699 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-47e2c821-06ee-4aa7-baae-daf9825de12f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:08.494387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-47e2c821-06ee-4aa7-baae-daf9825de12f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:08.494972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-47e2c821-06ee-4aa7-baae-daf9825de12f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:08.495828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-47e2c821-06ee-4aa7-baae-daf9825de12f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:08.496369 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-47e2c821-06ee-4aa7-baae-daf9825de12f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:08.659193 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:08.668256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:08.670016 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:08.671386 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3ad47f85-3837-403b-b9c6-4013c005cf19 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.321150 Jul 01 07:14:08.672297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 316/675] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:08 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:08.933270 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-47e2c821-06ee-4aa7-baae-daf9825de12f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:08.941431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-47e2c821-06ee-4aa7-baae-daf9825de12f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.458301 Jul 01 07:14:08.942610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 360/676] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:08 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:14:09.193032 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-65ae0513-b9c3-434c-9ced-9cacc1d3792f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:09.193552 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-65ae0513-b9c3-434c-9ced-9cacc1d3792f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:09.203985 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-65ae0513-b9c3-434c-9ced-9cacc1d3792f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:09.204466 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-65ae0513-b9c3-434c-9ced-9cacc1d3792f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:09.205230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-65ae0513-b9c3-434c-9ced-9cacc1d3792f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:09.207735 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-65ae0513-b9c3-434c-9ced-9cacc1d3792f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:09.334308 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-65ae0513-b9c3-434c-9ced-9cacc1d3792f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:09.341678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-65ae0513-b9c3-434c-9ced-9cacc1d3792f tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.153212 Jul 01 07:14:09.342238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 317/677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:09 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:09.689802 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:09.690418 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:09.697575 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:09.698028 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:09.698819 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:09.699261 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:09.838081 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:09.846958 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:09.849147 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:09.850434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5a05fbdf-a8ab-40c1-bc1a-52f427de81f8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.164670 Jul 01 07:14:09.851129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 361/678] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:09 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:09.959541 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-30d27544-9e1c-449c-b3e5-503a1288ec53 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:09.960245 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-30d27544-9e1c-449c-b3e5-503a1288ec53 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:09.966649 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-30d27544-9e1c-449c-b3e5-503a1288ec53 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:09.967212 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-30d27544-9e1c-449c-b3e5-503a1288ec53 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:09.968159 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-30d27544-9e1c-449c-b3e5-503a1288ec53 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:09.968608 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-30d27544-9e1c-449c-b3e5-503a1288ec53 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:10.101734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-30d27544-9e1c-449c-b3e5-503a1288ec53 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:10.109597 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-30d27544-9e1c-449c-b3e5-503a1288ec53 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.154512 Jul 01 07:14:10.110169 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 318/679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:09 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:10.358574 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-afab5837-4ab7-47b9-8758-2d5c75158eaf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:10.359238 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-afab5837-4ab7-47b9-8758-2d5c75158eaf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:10.365695 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-afab5837-4ab7-47b9-8758-2d5c75158eaf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:10.367060 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-afab5837-4ab7-47b9-8758-2d5c75158eaf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:10.367889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-afab5837-4ab7-47b9-8758-2d5c75158eaf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:10.368332 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-afab5837-4ab7-47b9-8758-2d5c75158eaf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:10.493751 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-afab5837-4ab7-47b9-8758-2d5c75158eaf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:10.501019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-afab5837-4ab7-47b9-8758-2d5c75158eaf tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.146269 Jul 01 07:14:10.501582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 362/680] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:10 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:10.869129 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:10.869733 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:10.875777 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:10.876227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:10.876975 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:10.877432 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:11.004991 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:11.013348 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:11.014890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:11.016034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ae359a83-1596-4a87-af2e-109a3b46dfce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.150761 Jul 01 07:14:11.016582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 319/681] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:10 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:11.126443 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f68471f1-746c-4b83-9d98-9407b1c67a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:11.127012 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f68471f1-746c-4b83-9d98-9407b1c67a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:11.133395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f68471f1-746c-4b83-9d98-9407b1c67a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:11.133844 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f68471f1-746c-4b83-9d98-9407b1c67a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:11.134606 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f68471f1-746c-4b83-9d98-9407b1c67a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:11.135071 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f68471f1-746c-4b83-9d98-9407b1c67a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:11.264939 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f68471f1-746c-4b83-9d98-9407b1c67a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:11.273207 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f68471f1-746c-4b83-9d98-9407b1c67a8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.150650 Jul 01 07:14:11.273765 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 363/682] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:11 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:11.518296 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-efbedc35-dffc-444f-a1ef-b8c67f630a27 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:11.518951 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-efbedc35-dffc-444f-a1ef-b8c67f630a27 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:11.525550 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-efbedc35-dffc-444f-a1ef-b8c67f630a27 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:11.525999 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-efbedc35-dffc-444f-a1ef-b8c67f630a27 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:11.526755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-efbedc35-dffc-444f-a1ef-b8c67f630a27 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:11.527213 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-efbedc35-dffc-444f-a1ef-b8c67f630a27 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:11.571177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:11.652053 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-efbedc35-dffc-444f-a1ef-b8c67f630a27 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:11.659355 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-efbedc35-dffc-444f-a1ef-b8c67f630a27 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.144908 Jul 01 07:14:11.659949 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 320/683] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:11 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:12.034866 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:12.035486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:12.041508 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:12.041956 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:12.042742 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:12.043205 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:12.169650 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:12.178462 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:12.180009 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:12.181157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7f593914-4d05-4e1d-95cc-156ed82561e8 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.151229 Jul 01 07:14:12.181716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 364/684] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:12 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:12.290449 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a233d089-b87e-414e-9c36-fac00c6b8d42 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:12.291230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a233d089-b87e-414e-9c36-fac00c6b8d42 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:12.297496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a233d089-b87e-414e-9c36-fac00c6b8d42 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:12.297959 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a233d089-b87e-414e-9c36-fac00c6b8d42 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:12.298760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a233d089-b87e-414e-9c36-fac00c6b8d42 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:12.299278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a233d089-b87e-414e-9c36-fac00c6b8d42 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:12.409529 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-da16a8d7-de16-4dd5-87b9-936760f47eda req-0496060c-b54b-4ba8-a5aa-acf113e317aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899a2250-e578-4353-811f-840463c59e28", "name": "network-vif-plugged", "status": "completed", "tag": "a88548af-22d8-48bd-8703-434c5dc976e5"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:12.419894 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-da16a8d7-de16-4dd5-87b9-936760f47eda req-0496060c-b54b-4ba8-a5aa-acf113e317aa service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:12.420339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-da16a8d7-de16-4dd5-87b9-936760f47eda req-0496060c-b54b-4ba8-a5aa-acf113e317aa service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:12.430273 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a233d089-b87e-414e-9c36-fac00c6b8d42 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:12.434695 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-da16a8d7-de16-4dd5-87b9-936760f47eda req-0496060c-b54b-4ba8-a5aa-acf113e317aa service nova] Creating event network-vif-plugged:a88548af-22d8-48bd-8703-434c5dc976e5 for instance 899a2250-e578-4353-811f-840463c59e28 on hv-cinder-80721 Jul 01 07:14:12.439103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a233d089-b87e-414e-9c36-fac00c6b8d42 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.152404 Jul 01 07:14:12.439768 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 321/685] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:12 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:12.439892 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-da16a8d7-de16-4dd5-87b9-936760f47eda req-0496060c-b54b-4ba8-a5aa-acf113e317aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034833 Jul 01 07:14:12.440781 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 365/686] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:12.675837 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3efd10bc-7fe2-4d42-af0d-8b5b45344cd9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:12.676460 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3efd10bc-7fe2-4d42-af0d-8b5b45344cd9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:12.682406 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3efd10bc-7fe2-4d42-af0d-8b5b45344cd9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:12.682889 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3efd10bc-7fe2-4d42-af0d-8b5b45344cd9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:12.683748 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3efd10bc-7fe2-4d42-af0d-8b5b45344cd9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:12.684456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3efd10bc-7fe2-4d42-af0d-8b5b45344cd9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:13.083964 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3efd10bc-7fe2-4d42-af0d-8b5b45344cd9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:13.091366 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3efd10bc-7fe2-4d42-af0d-8b5b45344cd9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.419698 Jul 01 07:14:13.091927 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 322/687] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:12 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:13.200986 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:13.201692 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:13.208582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:13.209039 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:13.209813 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:13.210253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:13.337358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:13.345672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:13.347208 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:13.348358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2329de47-b103-4667-b33d-d495bcd0a32d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.152080 Jul 01 07:14:13.348910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 366/688] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:13 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:13.456436 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d8cbaaa7-ec32-45d2-a631-d563c01e2a8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:13.457050 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d8cbaaa7-ec32-45d2-a631-d563c01e2a8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:13.463793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d8cbaaa7-ec32-45d2-a631-d563c01e2a8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:13.464245 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d8cbaaa7-ec32-45d2-a631-d563c01e2a8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:13.465010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d8cbaaa7-ec32-45d2-a631-d563c01e2a8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:13.465446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d8cbaaa7-ec32-45d2-a631-d563c01e2a8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:13.594117 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d8cbaaa7-ec32-45d2-a631-d563c01e2a8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:13.601903 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d8cbaaa7-ec32-45d2-a631-d563c01e2a8c tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.149334 Jul 01 07:14:13.602459 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 323/689] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:13 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:14.107966 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-423c6bdd-5c8c-447b-ba77-ea51bce2580a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:14.108586 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-423c6bdd-5c8c-447b-ba77-ea51bce2580a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:14.115252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-423c6bdd-5c8c-447b-ba77-ea51bce2580a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:14.115706 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-423c6bdd-5c8c-447b-ba77-ea51bce2580a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:14.116483 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-423c6bdd-5c8c-447b-ba77-ea51bce2580a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:14.116923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-423c6bdd-5c8c-447b-ba77-ea51bce2580a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:14.247910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-423c6bdd-5c8c-447b-ba77-ea51bce2580a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:14.255298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-423c6bdd-5c8c-447b-ba77-ea51bce2580a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.151190 Jul 01 07:14:14.255864 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 367/690] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:14 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:14.366571 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:14.367206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:14.373310 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:14.373757 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:14.374537 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:14.375002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:14.502514 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:14.511434 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:14.512926 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:14.514071 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-602f92c5-5c9e-4e80-a5ee-ee1ddef75bce tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1810 microversion: 2.20 time: 0.151389 Jul 01 07:14:14.514614 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 324/691] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:14 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:14.619091 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-91922991-009d-4dd7-babe-abbbd0565e29 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:14.619630 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-91922991-009d-4dd7-babe-abbbd0565e29 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:14.625594 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-91922991-009d-4dd7-babe-abbbd0565e29 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:14.626034 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-91922991-009d-4dd7-babe-abbbd0565e29 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:14.626812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-91922991-009d-4dd7-babe-abbbd0565e29 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:14.627247 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-91922991-009d-4dd7-babe-abbbd0565e29 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:14.756610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-91922991-009d-4dd7-babe-abbbd0565e29 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:14.764446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-91922991-009d-4dd7-babe-abbbd0565e29 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.149260 Jul 01 07:14:14.765017 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 368/692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:14 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:15.272520 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bbcc2e91-7734-4e51-a670-5cec0964747e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:15.273123 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bbcc2e91-7734-4e51-a670-5cec0964747e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:15.279089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bbcc2e91-7734-4e51-a670-5cec0964747e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:15.279535 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bbcc2e91-7734-4e51-a670-5cec0964747e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:15.280281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bbcc2e91-7734-4e51-a670-5cec0964747e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:15.280709 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bbcc2e91-7734-4e51-a670-5cec0964747e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:15.404443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bbcc2e91-7734-4e51-a670-5cec0964747e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:15.411707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bbcc2e91-7734-4e51-a670-5cec0964747e tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.143623 Jul 01 07:14:15.412267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 325/693] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:15 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:15.532686 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:15.533221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:15.539801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:15.540252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:15.541019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:15.541460 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:15.671993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:15.680492 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:15.682376 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:15.683557 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ed736b58-a522-472d-8db8-7e0f9ea0700a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1797 microversion: 2.20 time: 0.154853 Jul 01 07:14:15.684377 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 369/694] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:14:15 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1797 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:14:15.781938 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-05bf5fa3-5aa4-4e36-9b2c-d61d327fea6b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:15.782551 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-05bf5fa3-5aa4-4e36-9b2c-d61d327fea6b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:15.789729 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-05bf5fa3-5aa4-4e36-9b2c-d61d327fea6b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:15.790124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-05bf5fa3-5aa4-4e36-9b2c-d61d327fea6b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:15.790945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-05bf5fa3-5aa4-4e36-9b2c-d61d327fea6b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:15.791417 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-05bf5fa3-5aa4-4e36-9b2c-d61d327fea6b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:15.914943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-05bf5fa3-5aa4-4e36-9b2c-d61d327fea6b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:15.922876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-05bf5fa3-5aa4-4e36-9b2c-d61d327fea6b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.144782 Jul 01 07:14:15.923450 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 326/695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:15 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:16.427800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-48b11870-7edd-4be3-90e1-91cd3425ab2a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:16.428416 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-48b11870-7edd-4be3-90e1-91cd3425ab2a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:16.430372 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:16.435833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-48b11870-7edd-4be3-90e1-91cd3425ab2a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:16.436283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-48b11870-7edd-4be3-90e1-91cd3425ab2a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:16.437047 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-48b11870-7edd-4be3-90e1-91cd3425ab2a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:16.437480 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-48b11870-7edd-4be3-90e1-91cd3425ab2a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:16.570052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-48b11870-7edd-4be3-90e1-91cd3425ab2a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:16.577593 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-48b11870-7edd-4be3-90e1-91cd3425ab2a tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.153617 Jul 01 07:14:16.578148 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 370/696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:16 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:16.943331 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-41dff1f9-1f6a-4b7d-921d-53faad35a005 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:16.944131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-41dff1f9-1f6a-4b7d-921d-53faad35a005 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:16.950090 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41dff1f9-1f6a-4b7d-921d-53faad35a005 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:16.950526 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41dff1f9-1f6a-4b7d-921d-53faad35a005 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:16.951321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41dff1f9-1f6a-4b7d-921d-53faad35a005 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:16.951759 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41dff1f9-1f6a-4b7d-921d-53faad35a005 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:17.084860 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-41dff1f9-1f6a-4b7d-921d-53faad35a005 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:17.088410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:17.095540 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-41dff1f9-1f6a-4b7d-921d-53faad35a005 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.158982 Jul 01 07:14:17.096103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 327/697] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:16 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:17.365732 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b676c44b-6c95-463e-8d66-d5fad2e6e271 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:17.366341 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b676c44b-6c95-463e-8d66-d5fad2e6e271 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:17.372231 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b676c44b-6c95-463e-8d66-d5fad2e6e271 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:17.372675 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b676c44b-6c95-463e-8d66-d5fad2e6e271 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:17.373427 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b676c44b-6c95-463e-8d66-d5fad2e6e271 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:17.373854 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b676c44b-6c95-463e-8d66-d5fad2e6e271 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:17.377800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=100 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:17.500027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b676c44b-6c95-463e-8d66-d5fad2e6e271 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:17.508500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b676c44b-6c95-463e-8d66-d5fad2e6e271 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1594 microversion: 2.1 time: 0.146544 Jul 01 07:14:17.509051 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 371/698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:17 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1594 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:17.594549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-166322b2-4be7-41a1-8302-bcdca0a82f70 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:17.595207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-166322b2-4be7-41a1-8302-bcdca0a82f70 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:17.602179 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-166322b2-4be7-41a1-8302-bcdca0a82f70 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:17.602752 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-166322b2-4be7-41a1-8302-bcdca0a82f70 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:17.603543 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-166322b2-4be7-41a1-8302-bcdca0a82f70 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:17.603983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-166322b2-4be7-41a1-8302-bcdca0a82f70 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:17.829279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-166322b2-4be7-41a1-8302-bcdca0a82f70 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:17.836683 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-166322b2-4be7-41a1-8302-bcdca0a82f70 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1319 microversion: 2.1 time: 0.245954 Jul 01 07:14:17.837255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 328/699] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:17 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:18.113501 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-49589fa9-b377-45ed-be95-16aad72a95e6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:18.114211 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-49589fa9-b377-45ed-be95-16aad72a95e6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:18.120763 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-49589fa9-b377-45ed-be95-16aad72a95e6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:18.121216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-49589fa9-b377-45ed-be95-16aad72a95e6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:18.121985 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-49589fa9-b377-45ed-be95-16aad72a95e6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:18.122422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-49589fa9-b377-45ed-be95-16aad72a95e6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:18.361374 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-49589fa9-b377-45ed-be95-16aad72a95e6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:18.369180 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-49589fa9-b377-45ed-be95-16aad72a95e6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.259675 Jul 01 07:14:18.369750 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 372/700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:18 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:18.853275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e36bae7f-8c99-4635-bbd1-9863f2bc7a05 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:18.853877 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e36bae7f-8c99-4635-bbd1-9863f2bc7a05 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:18.860255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e36bae7f-8c99-4635-bbd1-9863f2bc7a05 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:18.860692 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e36bae7f-8c99-4635-bbd1-9863f2bc7a05 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:18.861460 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e36bae7f-8c99-4635-bbd1-9863f2bc7a05 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:18.861874 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e36bae7f-8c99-4635-bbd1-9863f2bc7a05 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:19.077692 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e36bae7f-8c99-4635-bbd1-9863f2bc7a05 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:19.085154 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e36bae7f-8c99-4635-bbd1-9863f2bc7a05 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1507 microversion: 2.1 time: 0.235745 Jul 01 07:14:19.085721 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 329/701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:18 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:19.101897 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f561b236-51c0-4ad7-a4da-aac1de9f28b9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad9e9040-28bf-4a5b-9a44-a86b52f7a164", "device": "/dev/sdb"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:19.103098 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f561b236-51c0-4ad7-a4da-aac1de9f28b9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:19.109144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f561b236-51c0-4ad7-a4da-aac1de9f28b9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:19.109591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f561b236-51c0-4ad7-a4da-aac1de9f28b9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:19.110353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f561b236-51c0-4ad7-a4da-aac1de9f28b9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:19.110806 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f561b236-51c0-4ad7-a4da-aac1de9f28b9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:19.360632 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-ee20983b-266d-43a7-b687-c0acbf5541e7 req-07a8d259-1f79-4421-af0f-11c34ef7963d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a035c87f-f7c1-4663-babc-7e64de9f1718", "tag": "a0ad1989-7e46-4e7a-a4e2-e30646d4df95"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:19.368626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f561b236-51c0-4ad7-a4da-aac1de9f28b9 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "POST /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270748 Jul 01 07:14:19.370308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 373/702] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:14:19 2022] POST /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:19.370548 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-ee20983b-266d-43a7-b687-c0acbf5541e7 req-07a8d259-1f79-4421-af0f-11c34ef7963d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:19.371252 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-ee20983b-266d-43a7-b687-c0acbf5541e7 req-07a8d259-1f79-4421-af0f-11c34ef7963d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:19.401707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-ee20983b-266d-43a7-b687-c0acbf5541e7 req-07a8d259-1f79-4421-af0f-11c34ef7963d service nova] Creating event network-changed:a0ad1989-7e46-4e7a-a4e2-e30646d4df95 for instance a035c87f-f7c1-4663-babc-7e64de9f1718 on hv-cinder-80721 Jul 01 07:14:19.401880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7089352c-e504-411b-b132-24a016d01187 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:19.402854 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7089352c-e504-411b-b132-24a016d01187 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:19.412544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-ee20983b-266d-43a7-b687-c0acbf5541e7 req-07a8d259-1f79-4421-af0f-11c34ef7963d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055961 Jul 01 07:14:19.413346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7089352c-e504-411b-b132-24a016d01187 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:19.414094 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7089352c-e504-411b-b132-24a016d01187 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:19.415349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7089352c-e504-411b-b132-24a016d01187 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:19.415635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7089352c-e504-411b-b132-24a016d01187 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:19.417910 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 330/703] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:14:19.698811 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7089352c-e504-411b-b132-24a016d01187 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:19.708556 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7089352c-e504-411b-b132-24a016d01187 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.316987 Jul 01 07:14:19.718024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 374/704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:19 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:20.556654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b148a9e8-1134-4b7e-b8b7-ad150f52da9b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1008703368"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:20.557272 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b148a9e8-1134-4b7e-b8b7-ad150f52da9b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:20.564102 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b148a9e8-1134-4b7e-b8b7-ad150f52da9b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:20.564551 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b148a9e8-1134-4b7e-b8b7-ad150f52da9b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:20.565301 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b148a9e8-1134-4b7e-b8b7-ad150f52da9b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:20.565729 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b148a9e8-1134-4b7e-b8b7-ad150f52da9b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:20.694015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.network.security_group_api [None req-b148a9e8-1134-4b7e-b8b7-ad150f52da9b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Adding security group 4a576056-5dd2-4d1f-afe7-f51a18558b76 to port a0ad1989-7e46-4e7a-a4e2-e30646d4df95 Jul 01 07:14:20.725885 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7065a338-1ea2-40f9-8666-5394fce7cc30 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:20.727280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7065a338-1ea2-40f9-8666-5394fce7cc30 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:20.741056 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7065a338-1ea2-40f9-8666-5394fce7cc30 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:20.741511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7065a338-1ea2-40f9-8666-5394fce7cc30 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:20.742292 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7065a338-1ea2-40f9-8666-5394fce7cc30 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:20.742733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7065a338-1ea2-40f9-8666-5394fce7cc30 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:20.942638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7065a338-1ea2-40f9-8666-5394fce7cc30 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:20.950640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7065a338-1ea2-40f9-8666-5394fce7cc30 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.229056 Jul 01 07:14:20.951238 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 375/705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:20 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:21.115256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b148a9e8-1134-4b7e-b8b7-ad150f52da9b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "POST /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/action" status: 202 len: 0 microversion: 2.1 time: 0.562622 Jul 01 07:14:21.120012 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 331/706] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:14:20 2022] POST /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:14:21.124394 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-14b2879b-19c0-4d55-86ba-8d0c9c403c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:21.125007 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-14b2879b-19c0-4d55-86ba-8d0c9c403c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:21.131144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-14b2879b-19c0-4d55-86ba-8d0c9c403c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:21.131599 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-14b2879b-19c0-4d55-86ba-8d0c9c403c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:21.132876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-14b2879b-19c0-4d55-86ba-8d0c9c403c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:21.133557 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-14b2879b-19c0-4d55-86ba-8d0c9c403c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:21.304612 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-14b2879b-19c0-4d55-86ba-8d0c9c403c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:21.317575 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-14b2879b-19c0-4d55-86ba-8d0c9c403c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1759 microversion: 2.1 time: 0.196964 Jul 01 07:14:21.318168 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 376/707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:21 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1759 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:14:21.427150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-62b0e84f-2ccd-4dc5-abbd-6f114a8e921c req-cac7eb1f-bc28-44ee-adf8-0b28579d43ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a035c87f-f7c1-4663-babc-7e64de9f1718", "tag": "a0ad1989-7e46-4e7a-a4e2-e30646d4df95"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:21.430726 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=67 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:21.437157 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-62b0e84f-2ccd-4dc5-abbd-6f114a8e921c req-cac7eb1f-bc28-44ee-adf8-0b28579d43ec service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:21.437500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-62b0e84f-2ccd-4dc5-abbd-6f114a8e921c req-cac7eb1f-bc28-44ee-adf8-0b28579d43ec service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:21.449151 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-62b0e84f-2ccd-4dc5-abbd-6f114a8e921c req-cac7eb1f-bc28-44ee-adf8-0b28579d43ec service nova] Creating event network-changed:a0ad1989-7e46-4e7a-a4e2-e30646d4df95 for instance a035c87f-f7c1-4663-babc-7e64de9f1718 on hv-cinder-80721 Jul 01 07:14:21.453924 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-62b0e84f-2ccd-4dc5-abbd-6f114a8e921c req-cac7eb1f-bc28-44ee-adf8-0b28579d43ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030711 Jul 01 07:14:21.454954 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 332/708] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:14:21.968364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4073bc9d-ed95-4afd-85de-ce92e101512b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:21.968978 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4073bc9d-ed95-4afd-85de-ce92e101512b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:21.975667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4073bc9d-ed95-4afd-85de-ce92e101512b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:21.976115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4073bc9d-ed95-4afd-85de-ce92e101512b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:21.976887 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4073bc9d-ed95-4afd-85de-ce92e101512b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:21.977320 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4073bc9d-ed95-4afd-85de-ce92e101512b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:22.119233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4073bc9d-ed95-4afd-85de-ce92e101512b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:22.127193 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4073bc9d-ed95-4afd-85de-ce92e101512b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.162625 Jul 01 07:14:22.127761 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 377/709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:21 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:23.145321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2c0c5b9b-9423-4531-af50-3b78e2f2a97b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:23.146011 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2c0c5b9b-9423-4531-af50-3b78e2f2a97b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:23.152169 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2c0c5b9b-9423-4531-af50-3b78e2f2a97b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:23.152616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2c0c5b9b-9423-4531-af50-3b78e2f2a97b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:23.153369 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2c0c5b9b-9423-4531-af50-3b78e2f2a97b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:23.153804 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2c0c5b9b-9423-4531-af50-3b78e2f2a97b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:23.280021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2c0c5b9b-9423-4531-af50-3b78e2f2a97b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:23.287942 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2c0c5b9b-9423-4531-af50-3b78e2f2a97b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.147437 Jul 01 07:14:23.288500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 333/710] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:23 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:24.305085 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1f83e614-4803-4c05-9115-e01fe604f655 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:24.305702 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1f83e614-4803-4c05-9115-e01fe604f655 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:24.312561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1f83e614-4803-4c05-9115-e01fe604f655 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:24.313048 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1f83e614-4803-4c05-9115-e01fe604f655 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:24.313824 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1f83e614-4803-4c05-9115-e01fe604f655 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:24.314273 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1f83e614-4803-4c05-9115-e01fe604f655 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:24.441301 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1f83e614-4803-4c05-9115-e01fe604f655 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:24.449695 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1f83e614-4803-4c05-9115-e01fe604f655 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.148471 Jul 01 07:14:24.450261 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 378/711] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:24 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:25.467496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5ed337b0-a047-4f11-b87a-ff4cd7db8c66 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:25.468028 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5ed337b0-a047-4f11-b87a-ff4cd7db8c66 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:25.475211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ed337b0-a047-4f11-b87a-ff4cd7db8c66 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:25.475662 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ed337b0-a047-4f11-b87a-ff4cd7db8c66 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:25.476419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ed337b0-a047-4f11-b87a-ff4cd7db8c66 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:25.476851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ed337b0-a047-4f11-b87a-ff4cd7db8c66 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:25.604630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5ed337b0-a047-4f11-b87a-ff4cd7db8c66 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:25.612398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5ed337b0-a047-4f11-b87a-ff4cd7db8c66 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.148911 Jul 01 07:14:25.612960 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 334/712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:25 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:26.629391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-145369bc-7060-47ed-8355-b3939c2ad2a3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:26.629996 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-145369bc-7060-47ed-8355-b3939c2ad2a3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:26.636462 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-145369bc-7060-47ed-8355-b3939c2ad2a3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:26.636906 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-145369bc-7060-47ed-8355-b3939c2ad2a3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:26.637661 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-145369bc-7060-47ed-8355-b3939c2ad2a3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:26.638091 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-145369bc-7060-47ed-8355-b3939c2ad2a3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:26.761603 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-145369bc-7060-47ed-8355-b3939c2ad2a3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:26.769422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-145369bc-7060-47ed-8355-b3939c2ad2a3 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.143940 Jul 01 07:14:26.769990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 379/713] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:26 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:27.787268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-40f4ceeb-149e-47c5-ad5e-c8745f05aa46 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:27.787874 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-40f4ceeb-149e-47c5-ad5e-c8745f05aa46 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:27.794377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-40f4ceeb-149e-47c5-ad5e-c8745f05aa46 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:27.794855 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-40f4ceeb-149e-47c5-ad5e-c8745f05aa46 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:27.795613 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-40f4ceeb-149e-47c5-ad5e-c8745f05aa46 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:27.796045 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-40f4ceeb-149e-47c5-ad5e-c8745f05aa46 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:27.924711 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-40f4ceeb-149e-47c5-ad5e-c8745f05aa46 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:27.932493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-40f4ceeb-149e-47c5-ad5e-c8745f05aa46 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.149678 Jul 01 07:14:27.933047 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 335/714] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:27 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:28.949454 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8fb005c1-7812-4692-8d1e-e2b05987dbfd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:28.950062 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8fb005c1-7812-4692-8d1e-e2b05987dbfd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:28.956212 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8fb005c1-7812-4692-8d1e-e2b05987dbfd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:28.956658 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8fb005c1-7812-4692-8d1e-e2b05987dbfd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:28.957441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8fb005c1-7812-4692-8d1e-e2b05987dbfd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:28.957853 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8fb005c1-7812-4692-8d1e-e2b05987dbfd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:29.096609 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8fb005c1-7812-4692-8d1e-e2b05987dbfd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:29.105193 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8fb005c1-7812-4692-8d1e-e2b05987dbfd tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.159495 Jul 01 07:14:29.105830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 380/715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:28 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:30.123545 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c28e9d9f-14e4-4563-a24c-4e91657589ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:30.124151 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c28e9d9f-14e4-4563-a24c-4e91657589ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:30.130622 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c28e9d9f-14e4-4563-a24c-4e91657589ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:30.131122 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c28e9d9f-14e4-4563-a24c-4e91657589ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:30.131882 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c28e9d9f-14e4-4563-a24c-4e91657589ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:30.132315 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c28e9d9f-14e4-4563-a24c-4e91657589ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:30.263268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c28e9d9f-14e4-4563-a24c-4e91657589ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:30.271677 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c28e9d9f-14e4-4563-a24c-4e91657589ea tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.151884 Jul 01 07:14:30.272228 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 336/716] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:30 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:31.289184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7ef28022-f5ab-4005-aa14-556cf8982afc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:31.289801 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7ef28022-f5ab-4005-aa14-556cf8982afc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:31.296518 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ef28022-f5ab-4005-aa14-556cf8982afc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:31.296968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ef28022-f5ab-4005-aa14-556cf8982afc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:31.297727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ef28022-f5ab-4005-aa14-556cf8982afc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:31.298165 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ef28022-f5ab-4005-aa14-556cf8982afc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:31.425900 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7ef28022-f5ab-4005-aa14-556cf8982afc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:31.433725 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7ef28022-f5ab-4005-aa14-556cf8982afc tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.148881 Jul 01 07:14:31.434563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 381/717] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:31 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:32.450737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ebbc820f-aea3-47e7-bdb2-e88f5ba646c2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:32.451302 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ebbc820f-aea3-47e7-bdb2-e88f5ba646c2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:32.457843 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ebbc820f-aea3-47e7-bdb2-e88f5ba646c2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:32.458285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ebbc820f-aea3-47e7-bdb2-e88f5ba646c2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:32.459069 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ebbc820f-aea3-47e7-bdb2-e88f5ba646c2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:32.459499 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ebbc820f-aea3-47e7-bdb2-e88f5ba646c2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:32.589534 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ebbc820f-aea3-47e7-bdb2-e88f5ba646c2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:32.597287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ebbc820f-aea3-47e7-bdb2-e88f5ba646c2 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.150811 Jul 01 07:14:32.598346 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 337/718] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:32 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:33.615402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-dc39075e-6ee6-492c-ac96-151e47761c90 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:33.616014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-dc39075e-6ee6-492c-ac96-151e47761c90 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:33.622400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc39075e-6ee6-492c-ac96-151e47761c90 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:33.622884 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc39075e-6ee6-492c-ac96-151e47761c90 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:33.623641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc39075e-6ee6-492c-ac96-151e47761c90 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:33.624072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc39075e-6ee6-492c-ac96-151e47761c90 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:33.748658 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-dc39075e-6ee6-492c-ac96-151e47761c90 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:33.756442 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-dc39075e-6ee6-492c-ac96-151e47761c90 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.145531 Jul 01 07:14:33.757012 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 382/719] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:33 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:34.781009 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d2762c7e-c199-47e2-990c-8e9292ced48f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:34.781763 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d2762c7e-c199-47e2-990c-8e9292ced48f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:34.788651 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d2762c7e-c199-47e2-990c-8e9292ced48f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:34.789102 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d2762c7e-c199-47e2-990c-8e9292ced48f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:34.789876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d2762c7e-c199-47e2-990c-8e9292ced48f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:34.790310 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d2762c7e-c199-47e2-990c-8e9292ced48f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:35.045629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d2762c7e-c199-47e2-990c-8e9292ced48f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:35.053476 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d2762c7e-c199-47e2-990c-8e9292ced48f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1735 microversion: 2.1 time: 0.276352 Jul 01 07:14:35.054037 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 338/720] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:34 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1735 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:36.070296 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b34eae1e-1d6f-4689-b256-db248fc28bb8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:36.070842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b34eae1e-1d6f-4689-b256-db248fc28bb8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:36.077367 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b34eae1e-1d6f-4689-b256-db248fc28bb8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:36.077819 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b34eae1e-1d6f-4689-b256-db248fc28bb8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:36.078590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b34eae1e-1d6f-4689-b256-db248fc28bb8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:36.079063 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b34eae1e-1d6f-4689-b256-db248fc28bb8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:36.208996 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b34eae1e-1d6f-4689-b256-db248fc28bb8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:36.216848 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b34eae1e-1d6f-4689-b256-db248fc28bb8 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1715 microversion: 2.1 time: 0.150439 Jul 01 07:14:36.217405 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 383/721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:36 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:36.270701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:36.271207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:36.277647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:36.278092 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:36.278884 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:36.279321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:36.400991 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] HTTP exception thrown: Cannot 'detach_volume' instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 while it is in vm_state rescued Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Request method failure captured: Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: DELETE /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments/dd2fdb5a-07ba-43a3-bd52-df1f6512db2d HTTP/1.1 Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1vWP5A9U2vwZcgA-tmIL0Abtmkf8fLJBmpYavmK6tX87ap-wh-MMPjAN54eWsMEvlA9CNKK8ZNJvBN_sDBho2dlNvmRqfRkrjl7kZ9B5Xu8-dyRRMNjooE7_SwyP6EeN2-wfuby7sk0XY1GHr44Xqj8fuKtr5klSaTUVH2ziarw-8 Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:14:36.402578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d94c1c234804421487c49cc9df6ff888"}]}] Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 4549c33736bc413a87460db0c43f5768 Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:14:36.404239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Cannot 'detach_volume' instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 while it is in vm_state rescued Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'server_id': '0c0721e7-9239-4832-b6dc-329e0682e8c6', 'id': 'dd2fdb5a-07ba-43a3-bd52-df1f6512db2d'} Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:14:36.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 while it is in vm_state rescued Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 while it is in vm_state rescued Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:14:36.406744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Returning 409 to user: Cannot 'detach_volume' instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 while it is in vm_state rescued {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:14:36.408088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-928e08f7-6d32-4eab-820e-4d911a612241 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments/dd2fdb5a-07ba-43a3-bd52-df1f6512db2d" status: 409 len: 152 microversion: 2.1 time: 0.137856 Jul 01 07:14:36.408088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 339/722] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:14:36 2022] DELETE /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments/dd2fdb5a-07ba-43a3-bd52-df1f6512db2d => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 07:14:36.412853 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f8ac1207-cf67-4c2e-8f86-aebfeb50a0bb tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:36.413383 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f8ac1207-cf67-4c2e-8f86-aebfeb50a0bb tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:36.419245 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8ac1207-cf67-4c2e-8f86-aebfeb50a0bb tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:36.419698 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8ac1207-cf67-4c2e-8f86-aebfeb50a0bb tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:36.420460 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8ac1207-cf67-4c2e-8f86-aebfeb50a0bb tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:36.420896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8ac1207-cf67-4c2e-8f86-aebfeb50a0bb tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:36.486120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f8ac1207-cf67-4c2e-8f86-aebfeb50a0bb tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "POST /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/action" status: 202 len: 0 microversion: 2.1 time: 0.076959 Jul 01 07:14:36.486748 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 384/723] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:14:36 2022] POST /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:14:36.495258 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fe71d823-a55c-4113-975d-dfad9f542954 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:36.495981 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fe71d823-a55c-4113-975d-dfad9f542954 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:36.502820 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe71d823-a55c-4113-975d-dfad9f542954 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:36.503270 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe71d823-a55c-4113-975d-dfad9f542954 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:36.504095 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe71d823-a55c-4113-975d-dfad9f542954 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:36.504513 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe71d823-a55c-4113-975d-dfad9f542954 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:36.630234 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fe71d823-a55c-4113-975d-dfad9f542954 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:36.638112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fe71d823-a55c-4113-975d-dfad9f542954 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1723 microversion: 2.1 time: 0.146625 Jul 01 07:14:36.638673 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 340/724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:36 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:37.657316 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9f7ed358-aff5-4585-912a-e11006f20e05 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:37.658022 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9f7ed358-aff5-4585-912a-e11006f20e05 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:37.664877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f7ed358-aff5-4585-912a-e11006f20e05 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:37.665335 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f7ed358-aff5-4585-912a-e11006f20e05 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:37.666102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f7ed358-aff5-4585-912a-e11006f20e05 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:37.666539 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f7ed358-aff5-4585-912a-e11006f20e05 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:37.685462 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:37.794269 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9f7ed358-aff5-4585-912a-e11006f20e05 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:37.802115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9f7ed358-aff5-4585-912a-e11006f20e05 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1723 microversion: 2.1 time: 0.149498 Jul 01 07:14:37.802672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 385/725] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:37 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:38.819559 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c7f4dbe4-26a5-49f2-90dd-d3e3eda0668e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:38.820072 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c7f4dbe4-26a5-49f2-90dd-d3e3eda0668e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:38.826662 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c7f4dbe4-26a5-49f2-90dd-d3e3eda0668e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:38.827139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c7f4dbe4-26a5-49f2-90dd-d3e3eda0668e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:38.827912 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c7f4dbe4-26a5-49f2-90dd-d3e3eda0668e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:38.828344 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c7f4dbe4-26a5-49f2-90dd-d3e3eda0668e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:38.964828 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c7f4dbe4-26a5-49f2-90dd-d3e3eda0668e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:38.973705 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c7f4dbe4-26a5-49f2-90dd-d3e3eda0668e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1723 microversion: 2.1 time: 0.158029 Jul 01 07:14:38.981572 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 341/726] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:38 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:39.990939 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9109cd39-a008-4cde-8367-c041b491f39a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:39.991553 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9109cd39-a008-4cde-8367-c041b491f39a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:39.997952 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9109cd39-a008-4cde-8367-c041b491f39a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:39.998396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9109cd39-a008-4cde-8367-c041b491f39a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:39.999181 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9109cd39-a008-4cde-8367-c041b491f39a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:39.999614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9109cd39-a008-4cde-8367-c041b491f39a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:40.135979 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9109cd39-a008-4cde-8367-c041b491f39a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:40.143883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9109cd39-a008-4cde-8367-c041b491f39a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1723 microversion: 2.1 time: 0.157558 Jul 01 07:14:40.144499 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 386/727] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:39 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:41.161541 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-39aa2621-5cf1-42d1-b34a-0ac17b6ef55b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:41.162150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-39aa2621-5cf1-42d1-b34a-0ac17b6ef55b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:41.168698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-39aa2621-5cf1-42d1-b34a-0ac17b6ef55b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:41.169150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-39aa2621-5cf1-42d1-b34a-0ac17b6ef55b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:41.169909 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-39aa2621-5cf1-42d1-b34a-0ac17b6ef55b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:41.170342 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-39aa2621-5cf1-42d1-b34a-0ac17b6ef55b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:41.306338 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-39aa2621-5cf1-42d1-b34a-0ac17b6ef55b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:41.314486 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-39aa2621-5cf1-42d1-b34a-0ac17b6ef55b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1723 microversion: 2.1 time: 0.157374 Jul 01 07:14:41.315088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 342/728] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:41 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:42.332362 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1038dfff-2719-4924-a895-6d9d194e8b8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:42.332965 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1038dfff-2719-4924-a895-6d9d194e8b8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:42.339488 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1038dfff-2719-4924-a895-6d9d194e8b8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:42.339930 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1038dfff-2719-4924-a895-6d9d194e8b8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:42.340687 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1038dfff-2719-4924-a895-6d9d194e8b8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:42.341146 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1038dfff-2719-4924-a895-6d9d194e8b8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:42.468954 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1038dfff-2719-4924-a895-6d9d194e8b8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:42.476819 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1038dfff-2719-4924-a895-6d9d194e8b8a tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1723 microversion: 2.1 time: 0.148932 Jul 01 07:14:42.477383 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 387/729] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:42 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:43.493952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b005522e-7ea1-4c21-a419-69d896009aa7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:43.494497 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b005522e-7ea1-4c21-a419-69d896009aa7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:43.500949 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b005522e-7ea1-4c21-a419-69d896009aa7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:43.501399 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b005522e-7ea1-4c21-a419-69d896009aa7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:43.502157 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b005522e-7ea1-4c21-a419-69d896009aa7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:43.502590 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b005522e-7ea1-4c21-a419-69d896009aa7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:43.631079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b005522e-7ea1-4c21-a419-69d896009aa7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:43.639056 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b005522e-7ea1-4c21-a419-69d896009aa7 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1723 microversion: 2.1 time: 0.149064 Jul 01 07:14:43.639619 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 343/730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:43 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:44.656865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ea7a510a-31b3-4128-91d8-9c3234d1010e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:44.657481 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ea7a510a-31b3-4128-91d8-9c3234d1010e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:44.664445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ea7a510a-31b3-4128-91d8-9c3234d1010e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:44.664899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ea7a510a-31b3-4128-91d8-9c3234d1010e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:44.665656 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ea7a510a-31b3-4128-91d8-9c3234d1010e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:44.666092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ea7a510a-31b3-4128-91d8-9c3234d1010e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:44.793871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ea7a510a-31b3-4128-91d8-9c3234d1010e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:44.802345 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ea7a510a-31b3-4128-91d8-9c3234d1010e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1723 microversion: 2.1 time: 0.149379 Jul 01 07:14:44.802932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 388/731] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:44 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:44.886647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e2fa200b-05b3-421a-925c-f2098d4584c7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:44.887198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e2fa200b-05b3-421a-925c-f2098d4584c7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:44.894569 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e2fa200b-05b3-421a-925c-f2098d4584c7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:44.895049 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e2fa200b-05b3-421a-925c-f2098d4584c7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:44.895817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e2fa200b-05b3-421a-925c-f2098d4584c7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:44.896248 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e2fa200b-05b3-421a-925c-f2098d4584c7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:44.976611 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-e2fa200b-05b3-421a-925c-f2098d4584c7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lazy-loading 'services' on Instance uuid 899a2250-e578-4353-811f-840463c59e28 {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:14:45.086722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e2fa200b-05b3-421a-925c-f2098d4584c7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "DELETE /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28/os-volume_attachments/ad9e9040-28bf-4a5b-9a44-a86b52f7a164" status: 202 len: 0 microversion: 2.1 time: 0.203735 Jul 01 07:14:45.087355 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 344/732] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:14:44 2022] DELETE /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28/os-volume_attachments/ad9e9040-28bf-4a5b-9a44-a86b52f7a164 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:14:45.819813 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-064f5098-5e59-49d2-9232-483333af6e3e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:45.820432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-064f5098-5e59-49d2-9232-483333af6e3e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:45.826936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-064f5098-5e59-49d2-9232-483333af6e3e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:45.827400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-064f5098-5e59-49d2-9232-483333af6e3e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:45.828175 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-064f5098-5e59-49d2-9232-483333af6e3e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:45.828612 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-064f5098-5e59-49d2-9232-483333af6e3e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:45.956843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-064f5098-5e59-49d2-9232-483333af6e3e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:45.964990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-064f5098-5e59-49d2-9232-483333af6e3e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1729 microversion: 2.1 time: 0.149061 Jul 01 07:14:45.965921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 389/733] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:45 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:45.983812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-40ab371e-14a3-4713-843e-3756318b938e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:45.984483 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-40ab371e-14a3-4713-843e-3756318b938e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:45.990590 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-40ab371e-14a3-4713-843e-3756318b938e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:45.991144 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-40ab371e-14a3-4713-843e-3756318b938e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:45.991987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-40ab371e-14a3-4713-843e-3756318b938e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:45.992419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-40ab371e-14a3-4713-843e-3756318b938e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:46.010412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:46.071604 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-40ab371e-14a3-4713-843e-3756318b938e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092772 Jul 01 07:14:46.072162 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 345/734] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jul 1 07:14:45 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:46.972068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-641732a5-8d8f-409e-b2fb-7f18aef073e1 req-61615746-e8e1-43f7-9c6f-242fb98e38c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0721e7-9239-4832-b6dc-329e0682e8c6", "tag": "55005d37-c17f-4cd9-ba0e-3e7034d6e963"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:46.976316 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=40 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:46.982896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-641732a5-8d8f-409e-b2fb-7f18aef073e1 req-61615746-e8e1-43f7-9c6f-242fb98e38c6 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:46.983631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-641732a5-8d8f-409e-b2fb-7f18aef073e1 req-61615746-e8e1-43f7-9c6f-242fb98e38c6 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:46.996095 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-641732a5-8d8f-409e-b2fb-7f18aef073e1 req-61615746-e8e1-43f7-9c6f-242fb98e38c6 service nova] Creating event network-changed:55005d37-c17f-4cd9-ba0e-3e7034d6e963 for instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 on hv-cinder-80721 Jul 01 07:14:47.000550 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-641732a5-8d8f-409e-b2fb-7f18aef073e1 req-61615746-e8e1-43f7-9c6f-242fb98e38c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032041 Jul 01 07:14:47.001176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 390/735] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:14:47.262136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3855ba41-5fde-4690-8469-517bec2ef2a7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:47.263405 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3855ba41-5fde-4690-8469-517bec2ef2a7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:47.270993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3855ba41-5fde-4690-8469-517bec2ef2a7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:47.271823 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3855ba41-5fde-4690-8469-517bec2ef2a7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:47.272843 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3855ba41-5fde-4690-8469-517bec2ef2a7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:47.273279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3855ba41-5fde-4690-8469-517bec2ef2a7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:47.299897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3855ba41-5fde-4690-8469-517bec2ef2a7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:14:47.396076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3855ba41-5fde-4690-8469-517bec2ef2a7 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "DELETE /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 204 len: 0 microversion: 2.1 time: 0.136766 Jul 01 07:14:47.400815 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 346/736] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:14:47 2022] DELETE /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:14:47.407104 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-de81d8df-23a9-4f18-9a97-80f27c6bf599 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:47.407811 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-de81d8df-23a9-4f18-9a97-80f27c6bf599 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:47.414321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-de81d8df-23a9-4f18-9a97-80f27c6bf599 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:47.414807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-de81d8df-23a9-4f18-9a97-80f27c6bf599 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:47.415576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-de81d8df-23a9-4f18-9a97-80f27c6bf599 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:47.416015 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-de81d8df-23a9-4f18-9a97-80f27c6bf599 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:47.545478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-de81d8df-23a9-4f18-9a97-80f27c6bf599 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:47.553610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-de81d8df-23a9-4f18-9a97-80f27c6bf599 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1513 microversion: 2.1 time: 0.151928 Jul 01 07:14:47.554403 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 391/737] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:47 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:14:48.572097 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-775ab273-693d-4b9d-b564-28ae4360235c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:48.572726 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-775ab273-693d-4b9d-b564-28ae4360235c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:48.579065 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-775ab273-693d-4b9d-b564-28ae4360235c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:48.579509 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-775ab273-693d-4b9d-b564-28ae4360235c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:48.580259 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-775ab273-693d-4b9d-b564-28ae4360235c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:48.580685 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-775ab273-693d-4b9d-b564-28ae4360235c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:48.709577 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-775ab273-693d-4b9d-b564-28ae4360235c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:48.716860 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-775ab273-693d-4b9d-b564-28ae4360235c tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1513 microversion: 2.1 time: 0.149062 Jul 01 07:14:48.717426 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 347/738] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:48 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:49.016524 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-80afd769-b682-420e-bd4d-b3b96288a080 req-0b547125-8bf0-4d57-98c0-73a12632adfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0721e7-9239-4832-b6dc-329e0682e8c6", "tag": "55005d37-c17f-4cd9-ba0e-3e7034d6e963"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:49.026072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-80afd769-b682-420e-bd4d-b3b96288a080 req-0b547125-8bf0-4d57-98c0-73a12632adfa service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:49.026515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-80afd769-b682-420e-bd4d-b3b96288a080 req-0b547125-8bf0-4d57-98c0-73a12632adfa service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:49.037380 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-80afd769-b682-420e-bd4d-b3b96288a080 req-0b547125-8bf0-4d57-98c0-73a12632adfa service nova] Creating event network-changed:55005d37-c17f-4cd9-ba0e-3e7034d6e963 for instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 on hv-cinder-80721 Jul 01 07:14:49.042087 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-80afd769-b682-420e-bd4d-b3b96288a080 req-0b547125-8bf0-4d57-98c0-73a12632adfa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029319 Jul 01 07:14:49.042673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 392/739] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:49.733431 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-30283c15-3c01-4d7c-8979-1458b43c0d43 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:49.734019 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-30283c15-3c01-4d7c-8979-1458b43c0d43 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:49.741610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-30283c15-3c01-4d7c-8979-1458b43c0d43 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:49.742238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-30283c15-3c01-4d7c-8979-1458b43c0d43 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:49.742842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-30283c15-3c01-4d7c-8979-1458b43c0d43 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:49.743281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-30283c15-3c01-4d7c-8979-1458b43c0d43 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:49.875797 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-30283c15-3c01-4d7c-8979-1458b43c0d43 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:49.886997 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-30283c15-3c01-4d7c-8979-1458b43c0d43 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1513 microversion: 2.1 time: 0.157414 Jul 01 07:14:49.887566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 348/740] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:49 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:50.904764 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:50.905449 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:50.911586 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:50.912037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:50.912840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:50.913282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:50.945275 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:50.945726 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:50.946183 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lazy-loading 'fault' on Instance uuid 899a2250-e578-4353-811f-840463c59e28 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:14:50.989995 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1957cb1501da480f9974bda730ce9db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd3241e9f134a7bb89bbaf40232959c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:50.997410 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9aecdc9a-9471-483a-9fec-f4a79c3d0155 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 200 len: 1309 microversion: 2.1 time: 0.097328 Jul 01 07:14:50.997980 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 393/741] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:50 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:51.056779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-8f0dfda9-88b9-426e-a57d-996e4474281b req-a42188fb-69d6-4699-b577-b14720de2eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899a2250-e578-4353-811f-840463c59e28", "name": "network-vif-deleted", "tag": "a88548af-22d8-48bd-8703-434c5dc976e5"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:51.065504 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-8f0dfda9-88b9-426e-a57d-996e4474281b req-a42188fb-69d6-4699-b577-b14720de2eb1 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:51.066559 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-8f0dfda9-88b9-426e-a57d-996e4474281b req-a42188fb-69d6-4699-b577-b14720de2eb1 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:51.076885 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-8f0dfda9-88b9-426e-a57d-996e4474281b req-a42188fb-69d6-4699-b577-b14720de2eb1 service nova] Creating event network-vif-deleted:a88548af-22d8-48bd-8703-434c5dc976e5 for instance 899a2250-e578-4353-811f-840463c59e28 on hv-cinder-80721 Jul 01 07:14:51.081556 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-8f0dfda9-88b9-426e-a57d-996e4474281b req-a42188fb-69d6-4699-b577-b14720de2eb1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028392 Jul 01 07:14:51.082105 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 349/742] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:52.014622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:52.015267 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] [instance: 899a2250-e578-4353-811f-840463c59e28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:52.023242 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:52.023742 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:52.024513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:52.024943 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:52.038416 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] HTTP exception thrown: Instance 899a2250-e578-4353-811f-840463c59e28 could not be found. Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Request method failure captured: Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 HTTP/1.1 Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp4Z-pBfPt7L96zaHWiTZe68D1Nl3A2SkdvAxXoXqN2GhEBBdpQM3XJHmucRJB4hch52PnaSxkyzKzy8T299I9QgVW9KtiDG6LfHtLl8x-nIZ2k0gVTp9Lhu5e1qLEjH7l3DqBMhcQrbh2BD6awNFc8a1SoKiLy9zBspf5nmPrUadLs Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: 6dd3241e9f134a7bb89bbaf40232959c Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1127969674 Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:14:52.040059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6dd3241e9f134a7bb89bbaf40232959c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6dd3241e9f134a7bb89bbaf40232959c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6dd3241e9f134a7bb89bbaf40232959c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6dd3241e9f134a7bb89bbaf40232959c"}]}] Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-VolumesSnapshotTestJSON-1127969674 Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: 6dd3241e9f134a7bb89bbaf40232959c Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1127969674 Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-VolumesSnapshotTestJSON-1127969674-project Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 1957cb1501da480f9974bda730ce9db3 Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-VolumesSnapshotTestJSON-1127969674-project Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 899a2250-e578-4353-811f-840463c59e28 could not be found. Jul 01 07:14:52.041432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '899a2250-e578-4353-811f-840463c59e28'} Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899a2250-e578-4353-811f-840463c59e28 could not be found. Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:14:52.042379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899a2250-e578-4353-811f-840463c59e28 could not be found. Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899a2250-e578-4353-811f-840463c59e28 could not be found. Jul 01 07:14:52.044002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:52.045312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] Returning 404 to user: Instance 899a2250-e578-4353-811f-840463c59e28 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:14:52.045312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-70de28d5-24fb-4f4f-85b1-441f0ba257b4 tempest-VolumesSnapshotTestJSON-1127969674 tempest-VolumesSnapshotTestJSON-1127969674-project] 10.222.0.48 "GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28" status: 404 len: 111 microversion: 2.1 time: 0.030746 Jul 01 07:14:52.045312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 394/743] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:52 2022] GET /compute/v2.1/servers/899a2250-e578-4353-811f-840463c59e28 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:14:56.874131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d7a441ca-a4f0-438f-a6dd-33ebaf66f6f5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:56.874719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d7a441ca-a4f0-438f-a6dd-33ebaf66f6f5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:56.876659 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:14:56.882175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d7a441ca-a4f0-438f-a6dd-33ebaf66f6f5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:56.882628 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d7a441ca-a4f0-438f-a6dd-33ebaf66f6f5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:56.883427 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d7a441ca-a4f0-438f-a6dd-33ebaf66f6f5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:56.883866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d7a441ca-a4f0-438f-a6dd-33ebaf66f6f5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:56.907518 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d7a441ca-a4f0-438f-a6dd-33ebaf66f6f5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8/ips" status: 200 len: 151 microversion: 2.1 time: 0.134180 Jul 01 07:14:56.908068 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 350/744] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:14:56 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8/ips => generated 151 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:14:56.919079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:14:56.920129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:56.926716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:56.927188 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:56.927943 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:56.928371 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:57.005985 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Invalid volume: volume f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3 is already attached to instances: 587ab81f-e92f-455f-8cc0-09463978813d Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: POST /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8/os-volume_attachments HTTP/1.1 Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 74 Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:14:57.007672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {"volumeAttachment": {"volumeId": "f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3"}} Jul 01 07:14:57.009282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Invalid volume: volume f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3 is already attached to instances: 587ab81f-e92f-455f-8cc0-09463978813d Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'server_id': 'd723a853-e49d-405c-9a21-8ce304f65da8', 'body': {'volumeAttachment': {'volumeId': 'f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3'}}} Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3 is already attached to instances: 587ab81f-e92f-455f-8cc0-09463978813d Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:57.010302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3 is already attached to instances: 587ab81f-e92f-455f-8cc0-09463978813d Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:14:57.011808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:14:57.013425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:14:57.013425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:14:57.013425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:14:57.013425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3 is already attached to instances: 587ab81f-e92f-455f-8cc0-09463978813d Jul 01 07:14:57.013425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:14:57.013425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 400 to user: Invalid volume: volume f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3 is already attached to instances: 587ab81f-e92f-455f-8cc0-09463978813d {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:14:57.013425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e05a04d0-6336-4fba-b77e-4d3e124001c7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094061 Jul 01 07:14:57.013425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 395/745] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:14:56 2022] POST /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:14:57.017780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2c3934f5-c253-4e5b-b4e9-441c9b2244a5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:57.018269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2c3934f5-c253-4e5b-b4e9-441c9b2244a5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:57.024680 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2c3934f5-c253-4e5b-b4e9-441c9b2244a5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:57.025123 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2c3934f5-c253-4e5b-b4e9-441c9b2244a5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:57.025876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2c3934f5-c253-4e5b-b4e9-441c9b2244a5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:57.026308 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2c3934f5-c253-4e5b-b4e9-441c9b2244a5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:57.050549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2c3934f5-c253-4e5b-b4e9-441c9b2244a5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:14:57.123142 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2c3934f5-c253-4e5b-b4e9-441c9b2244a5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 204 len: 0 microversion: 2.1 time: 0.108696 Jul 01 07:14:57.123654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 351/746] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:14:57 2022] DELETE /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:14:57.132188 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-830d0830-48d7-415b-965b-b85b45277b74 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:57.133040 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-830d0830-48d7-415b-965b-b85b45277b74 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:57.139777 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-830d0830-48d7-415b-965b-b85b45277b74 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:57.140224 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-830d0830-48d7-415b-965b-b85b45277b74 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:57.140990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-830d0830-48d7-415b-965b-b85b45277b74 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:57.141443 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-830d0830-48d7-415b-965b-b85b45277b74 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:57.274037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-830d0830-48d7-415b-965b-b85b45277b74 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:57.281649 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-830d0830-48d7-415b-965b-b85b45277b74 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1681 microversion: 2.1 time: 0.153869 Jul 01 07:14:57.282233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 396/747] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:57 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:58.299511 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4ed469cf-2c31-4093-8366-4788bff90a34 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:58.300897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4ed469cf-2c31-4093-8366-4788bff90a34 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:58.307312 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4ed469cf-2c31-4093-8366-4788bff90a34 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:58.307761 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4ed469cf-2c31-4093-8366-4788bff90a34 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:58.308521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4ed469cf-2c31-4093-8366-4788bff90a34 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:58.308957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4ed469cf-2c31-4093-8366-4788bff90a34 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:58.440146 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4ed469cf-2c31-4093-8366-4788bff90a34 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:58.447562 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4ed469cf-2c31-4093-8366-4788bff90a34 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1681 microversion: 2.1 time: 0.152233 Jul 01 07:14:58.448130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 352/748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:58 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:14:59.465366 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a544da42-13ba-4aec-bc18-e2a2ed8380bf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:14:59.465919 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a544da42-13ba-4aec-bc18-e2a2ed8380bf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:14:59.473213 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a544da42-13ba-4aec-bc18-e2a2ed8380bf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:59.473662 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a544da42-13ba-4aec-bc18-e2a2ed8380bf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:59.474456 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a544da42-13ba-4aec-bc18-e2a2ed8380bf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:14:59.474928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a544da42-13ba-4aec-bc18-e2a2ed8380bf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:14:59.609478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a544da42-13ba-4aec-bc18-e2a2ed8380bf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:14:59.617599 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a544da42-13ba-4aec-bc18-e2a2ed8380bf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1681 microversion: 2.1 time: 0.156129 Jul 01 07:14:59.618163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 397/749] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:14:59 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:00.635246 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2313629a-b47b-4a2a-8f6f-b3537becd9fa tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:00.635866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2313629a-b47b-4a2a-8f6f-b3537becd9fa tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:00.642523 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2313629a-b47b-4a2a-8f6f-b3537becd9fa tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:00.643026 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2313629a-b47b-4a2a-8f6f-b3537becd9fa tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:00.644514 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2313629a-b47b-4a2a-8f6f-b3537becd9fa tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:00.645178 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2313629a-b47b-4a2a-8f6f-b3537becd9fa tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:00.834374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2313629a-b47b-4a2a-8f6f-b3537becd9fa tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:00.841759 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2313629a-b47b-4a2a-8f6f-b3537becd9fa tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 200 len: 1681 microversion: 2.1 time: 0.210454 Jul 01 07:15:00.842332 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 353/750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:00 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:01.150750 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-f0a6dfd9-ce3a-4a1e-8719-f76204279d5b req-6c75dbf3-ca22-4909-87f9-02aad09db760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d723a853-e49d-405c-9a21-8ce304f65da8", "name": "network-vif-deleted", "tag": "342eab1d-fb07-4376-b0e3-5225ba34bca8"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:01.159995 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-f0a6dfd9-ce3a-4a1e-8719-f76204279d5b req-6c75dbf3-ca22-4909-87f9-02aad09db760 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:01.160541 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-f0a6dfd9-ce3a-4a1e-8719-f76204279d5b req-6c75dbf3-ca22-4909-87f9-02aad09db760 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:01.173959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-f0a6dfd9-ce3a-4a1e-8719-f76204279d5b req-6c75dbf3-ca22-4909-87f9-02aad09db760 service nova] Creating event network-vif-deleted:342eab1d-fb07-4376-b0e3-5225ba34bca8 for instance d723a853-e49d-405c-9a21-8ce304f65da8 on hv-cinder-80721 Jul 01 07:15:01.181915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-f0a6dfd9-ce3a-4a1e-8719-f76204279d5b req-6c75dbf3-ca22-4909-87f9-02aad09db760 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034679 Jul 01 07:15:01.182876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 398/751] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:01.862287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:01.863545 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:01.869952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:01.870404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:01.871247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:01.871749 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:01.888445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 HTTP/1.1 Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:15:01.890136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:15:01.891750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': 'd723a853-e49d-405c-9a21-8ce304f65da8'} Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:15:01.892851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:15:01.894905 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:01.898054 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:15:01.898054 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ebb3e528-8478-4ca2-b9d0-64b301ea6ff1 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 404 len: 111 microversion: 2.1 time: 0.037667 Jul 01 07:15:01.898054 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 354/752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:01 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:15:01.904642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ca9af58c-62de-41c9-9d57-728226058d4b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '.version_select at 0x7f2c4a50cee0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:01.907762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ca9af58c-62de-41c9-9d57-728226058d4b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [22e1e8f6-14b3-4fe0-a0a7-c5024b40b19f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 07:15:02.917286 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [None req-ca9af58c-62de-41c9-9d57-728226058d4b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [22e1e8f6-14b3-4fe0-a0a7-c5024b40b19f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55468. Jul 01 07:15:02.938321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ca9af58c-62de-41c9-9d57-728226058d4b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-122527863" status: 202 len: 0 microversion: 2.1 time: 1.038046 Jul 01 07:15:02.938942 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 399/753] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jul 1 07:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-122527863 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:15:03.610361 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1b935768-6812-4ac3-be2f-c39227d9923f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:03.611897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1b935768-6812-4ac3-be2f-c39227d9923f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:03.619426 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1b935768-6812-4ac3-be2f-c39227d9923f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:03.619915 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1b935768-6812-4ac3-be2f-c39227d9923f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:03.620681 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1b935768-6812-4ac3-be2f-c39227d9923f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:03.621277 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1b935768-6812-4ac3-be2f-c39227d9923f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:03.705069 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-1b935768-6812-4ac3-be2f-c39227d9923f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lazy-loading 'services' on Instance uuid 587ab81f-e92f-455f-8cc0-09463978813d {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:15:03.780584 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1b935768-6812-4ac3-be2f-c39227d9923f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments/f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3" status: 202 len: 0 microversion: 2.1 time: 0.174097 Jul 01 07:15:03.781183 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 355/754] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:15:03 2022] DELETE /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments/f84c8a46-4c3c-4f73-8d4e-c7c9dbda1bc3 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:15:03.790018 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a99ab55a-d18c-48ec-9658-e175078909e6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:03.791131 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a99ab55a-d18c-48ec-9658-e175078909e6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:03.798614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a99ab55a-d18c-48ec-9658-e175078909e6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:03.799173 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a99ab55a-d18c-48ec-9658-e175078909e6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:03.799936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a99ab55a-d18c-48ec-9658-e175078909e6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:03.800406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a99ab55a-d18c-48ec-9658-e175078909e6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:03.828822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a99ab55a-d18c-48ec-9658-e175078909e6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Jul 01 07:15:03.829361 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 400/755] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:15:03 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:04.842071 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a353ed28-8d42-47a8-9fba-33de60d6c20b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:04.843144 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a353ed28-8d42-47a8-9fba-33de60d6c20b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:04.850026 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a353ed28-8d42-47a8-9fba-33de60d6c20b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:04.850476 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a353ed28-8d42-47a8-9fba-33de60d6c20b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:04.851255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a353ed28-8d42-47a8-9fba-33de60d6c20b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:04.851689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a353ed28-8d42-47a8-9fba-33de60d6c20b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:04.879960 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a353ed28-8d42-47a8-9fba-33de60d6c20b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042999 Jul 01 07:15:04.880491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 356/756] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:15:04 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:05.891407 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a95402be-2e09-4d1c-8235-cb656c0002ed tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:05.892324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a95402be-2e09-4d1c-8235-cb656c0002ed tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:05.898755 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a95402be-2e09-4d1c-8235-cb656c0002ed tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:05.899235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a95402be-2e09-4d1c-8235-cb656c0002ed tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:05.899992 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a95402be-2e09-4d1c-8235-cb656c0002ed tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:05.900428 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a95402be-2e09-4d1c-8235-cb656c0002ed tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:05.929060 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a95402be-2e09-4d1c-8235-cb656c0002ed tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041529 Jul 01 07:15:05.929613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 401/757] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:15:05 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:15:06.940298 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c683b958-23ab-4ce9-8b79-3f308a745b0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:06.941215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c683b958-23ab-4ce9-8b79-3f308a745b0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:06.947665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c683b958-23ab-4ce9-8b79-3f308a745b0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:06.948115 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c683b958-23ab-4ce9-8b79-3f308a745b0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:06.948870 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c683b958-23ab-4ce9-8b79-3f308a745b0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:06.949305 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c683b958-23ab-4ce9-8b79-3f308a745b0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:06.978240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c683b958-23ab-4ce9-8b79-3f308a745b0c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 Jul 01 07:15:06.978804 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 357/758] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:15:06 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:07.990369 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ca6c911c-d2df-4ac9-aaa4-9bf8e43dc5c6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:07.991307 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ca6c911c-d2df-4ac9-aaa4-9bf8e43dc5c6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:07.997780 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ca6c911c-d2df-4ac9-aaa4-9bf8e43dc5c6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:07.998234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ca6c911c-d2df-4ac9-aaa4-9bf8e43dc5c6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:07.999024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ca6c911c-d2df-4ac9-aaa4-9bf8e43dc5c6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:07.999465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ca6c911c-d2df-4ac9-aaa4-9bf8e43dc5c6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:08.003067 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=79 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:08.028003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ca6c911c-d2df-4ac9-aaa4-9bf8e43dc5c6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042161 Jul 01 07:15:08.028545 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 402/759] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:15:07 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:09.042230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cad83863-5d40-469b-ae8e-c7cc50b72789 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:09.043180 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cad83863-5d40-469b-ae8e-c7cc50b72789 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:09.051054 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cad83863-5d40-469b-ae8e-c7cc50b72789 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:09.051500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cad83863-5d40-469b-ae8e-c7cc50b72789 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:09.052272 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cad83863-5d40-469b-ae8e-c7cc50b72789 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:09.052702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cad83863-5d40-469b-ae8e-c7cc50b72789 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:09.086636 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cad83863-5d40-469b-ae8e-c7cc50b72789 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050028 Jul 01 07:15:09.087235 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 358/760] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:15:09 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:15:09.144758 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-86a6fb5c-de2c-4d43-ae5b-84d9e9c941be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:09.145277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-86a6fb5c-de2c-4d43-ae5b-84d9e9c941be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:09.151868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-86a6fb5c-de2c-4d43-ae5b-84d9e9c941be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:09.152385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-86a6fb5c-de2c-4d43-ae5b-84d9e9c941be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:09.153078 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-86a6fb5c-de2c-4d43-ae5b-84d9e9c941be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:09.153762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-86a6fb5c-de2c-4d43-ae5b-84d9e9c941be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:09.186254 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-86a6fb5c-de2c-4d43-ae5b-84d9e9c941be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:15:09.269152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-86a6fb5c-de2c-4d43-ae5b-84d9e9c941be tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 204 len: 0 microversion: 2.1 time: 0.128092 Jul 01 07:15:09.269741 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 403/761] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:15:09 2022] DELETE /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:15:09.279981 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-abdfd04a-031f-40fb-8ad0-e058e2233fb4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:09.280606 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-abdfd04a-031f-40fb-8ad0-e058e2233fb4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:09.286555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-abdfd04a-031f-40fb-8ad0-e058e2233fb4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:09.287051 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-abdfd04a-031f-40fb-8ad0-e058e2233fb4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:09.287814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-abdfd04a-031f-40fb-8ad0-e058e2233fb4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:09.288252 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-abdfd04a-031f-40fb-8ad0-e058e2233fb4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:09.417584 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-abdfd04a-031f-40fb-8ad0-e058e2233fb4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:09.425042 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-abdfd04a-031f-40fb-8ad0-e058e2233fb4 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1681 microversion: 2.1 time: 0.149650 Jul 01 07:15:09.425594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 359/762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:09 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:15:10.443080 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d4b77481-dcfa-477e-8808-b9e8a980162c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:10.443777 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d4b77481-dcfa-477e-8808-b9e8a980162c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:10.450095 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d4b77481-dcfa-477e-8808-b9e8a980162c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:10.450591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d4b77481-dcfa-477e-8808-b9e8a980162c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:10.451338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d4b77481-dcfa-477e-8808-b9e8a980162c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:10.451765 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d4b77481-dcfa-477e-8808-b9e8a980162c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:10.581931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d4b77481-dcfa-477e-8808-b9e8a980162c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:10.589278 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d4b77481-dcfa-477e-8808-b9e8a980162c tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1681 microversion: 2.1 time: 0.150583 Jul 01 07:15:10.589836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 404/763] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:10 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:11.528885 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-ed7fd160-115d-479a-a7d5-7bc062dcc90b req-5c377bf1-b924-4ec6-bd6b-31d765421e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587ab81f-e92f-455f-8cc0-09463978813d", "name": "network-vif-deleted", "tag": "078a7f98-f4b7-4477-a055-a3fb79cc3fa2"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:11.546289 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-ed7fd160-115d-479a-a7d5-7bc062dcc90b req-5c377bf1-b924-4ec6-bd6b-31d765421e39 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:11.546289 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-ed7fd160-115d-479a-a7d5-7bc062dcc90b req-5c377bf1-b924-4ec6-bd6b-31d765421e39 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:11.547444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:11.556418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-ed7fd160-115d-479a-a7d5-7bc062dcc90b req-5c377bf1-b924-4ec6-bd6b-31d765421e39 service nova] Creating event network-vif-deleted:078a7f98-f4b7-4477-a055-a3fb79cc3fa2 for instance 587ab81f-e92f-455f-8cc0-09463978813d on hv-cinder-80721 Jul 01 07:15:11.561990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-ed7fd160-115d-479a-a7d5-7bc062dcc90b req-5c377bf1-b924-4ec6-bd6b-31d765421e39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036647 Jul 01 07:15:11.565690 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 360/764] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:11.606715 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e305d9e6-7cf3-4a93-8ef1-6e52cd0d8d58 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:11.607553 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e305d9e6-7cf3-4a93-8ef1-6e52cd0d8d58 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:11.614999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e305d9e6-7cf3-4a93-8ef1-6e52cd0d8d58 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:11.615370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e305d9e6-7cf3-4a93-8ef1-6e52cd0d8d58 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:11.616363 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e305d9e6-7cf3-4a93-8ef1-6e52cd0d8d58 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:11.617246 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e305d9e6-7cf3-4a93-8ef1-6e52cd0d8d58 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:11.687492 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e305d9e6-7cf3-4a93-8ef1-6e52cd0d8d58 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:11.697411 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e305d9e6-7cf3-4a93-8ef1-6e52cd0d8d58 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 200 len: 1326 microversion: 2.1 time: 0.094281 Jul 01 07:15:11.698562 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 405/765] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:11 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:12.716494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:12.717183 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:12.724769 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:12.725213 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:12.725967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:12.726399 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:12.739412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d HTTP/1.1 Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:15:12.740990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:15:12.742566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '587ab81f-e92f-455f-8cc0-09463978813d'} Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:15:12.743547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:15:12.745089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:12.746788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:15:12.746788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e2b22fa1-b1f9-471d-9a13-8bda5a54fbb6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 404 len: 111 microversion: 2.1 time: 0.030801 Jul 01 07:15:12.746788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 361/766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:12 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:15:12.752239 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a83d620f-f247-415c-b762-f35b3192e015 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '.version_select at 0x7f2c4a3afc10>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:12.769369 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a83d620f-f247-415c-b762-f35b3192e015 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438463469" status: 202 len: 0 microversion: 2.1 time: 0.021595 Jul 01 07:15:12.769914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 406/767] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jul 1 07:15:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438463469 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:15:13.580761 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fcf6c478-a2a3-4d14-90ff-4f97a3c2efd9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: .version_select at 0x7f2c4a2ae820>, body: {"keypair": {"name": "tempest-keypair-1560886393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHyg8NsQHOpn79/p26+2zHj+xngWRUXMpXO+v4Q5hZNe9383Dg8W1ZHRK6aLNThaPvlYBz4luyzkbxTppbGQxFpvW+qi06FkntjN1tKxrYJixTqB0II6Jt44JNaYDkojQ=="}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:13.594273 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-fcf6c478-a2a3-4d14-90ff-4f97a3c2efd9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for project dc0aa7206a704d45a610dccc24ec8767. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:15:13.598005 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-fcf6c478-a2a3-4d14-90ff-4f97a3c2efd9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for user df44f27783d34370ad83470ffde558a8 and project dc0aa7206a704d45a610dccc24ec8767. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:15:13.619347 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fcf6c478-a2a3-4d14-90ff-4f97a3c2efd9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042397 Jul 01 07:15:13.620227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 362/768] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:15:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:14.662106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9c6ba327-8c87-4c1f-98b0-dd90f9ee7e84 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:14.662720 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9c6ba327-8c87-4c1f-98b0-dd90f9ee7e84 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:14.670158 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9c6ba327-8c87-4c1f-98b0-dd90f9ee7e84 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:14.670611 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9c6ba327-8c87-4c1f-98b0-dd90f9ee7e84 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:14.671447 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9c6ba327-8c87-4c1f-98b0-dd90f9ee7e84 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:14.671889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9c6ba327-8c87-4c1f-98b0-dd90f9ee7e84 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:14.696507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-9c6ba327-8c87-4c1f-98b0-dd90f9ee7e84 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lazy-loading 'flavor' on Instance uuid 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:15:14.773188 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9c6ba327-8c87-4c1f-98b0-dd90f9ee7e84 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "POST /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7/action" status: 202 len: 0 microversion: 2.1 time: 0.115130 Jul 01 07:15:14.773787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 407/769] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:15:14 2022] POST /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:15:14.782581 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-03e6ed0e-24b1-4105-b209-94835531e047 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:14.783223 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-03e6ed0e-24b1-4105-b209-94835531e047 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:14.791231 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-03e6ed0e-24b1-4105-b209-94835531e047 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:14.791686 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-03e6ed0e-24b1-4105-b209-94835531e047 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:14.792456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-03e6ed0e-24b1-4105-b209-94835531e047 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:14.792885 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-03e6ed0e-24b1-4105-b209-94835531e047 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:15.061911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-03e6ed0e-24b1-4105-b209-94835531e047 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:15.070077 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-03e6ed0e-24b1-4105-b209-94835531e047 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.291924 Jul 01 07:15:15.070728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 363/770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:14 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:15.173999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1591686966", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f720862-6697-4120-b152-2a0712a988e8"}], "security_groups": [{"name": "tempest-securitygroup--1517401518"}], "key_name": "tempest-keypair-1560886393", "user_data": "}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:15.283382 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] validate_networks() for [('2f720862-6697-4120-b152-2a0712a988e8', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:15:15.644253 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:15:15.644679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:15:15.645167 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:15:15.645557 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:15:15.645969 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:15:15.654614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:15.655099 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:15.655892 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:15.656325 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:15.673422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for project dc0aa7206a704d45a610dccc24ec8767. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:15:15.677429 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for user df44f27783d34370ad83470ffde558a8 and project dc0aa7206a704d45a610dccc24ec8767. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:15:15.688270 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:15:15.690551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:15:15.734616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5dcc2dbf-e63a-41c5-b02c-9da0ac3a8c5b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565489 Jul 01 07:15:15.735322 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 408/771] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:15:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:15:15.745737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8fd13c34-d495-4fbb-9a80-84fa6276add5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:15.746462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8fd13c34-d495-4fbb-9a80-84fa6276add5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:15.799097 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8fd13c34-d495-4fbb-9a80-84fa6276add5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:15.807013 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8fd13c34-d495-4fbb-9a80-84fa6276add5 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1242 microversion: 2.1 time: 0.065482 Jul 01 07:15:15.807583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 364/772] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:15 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:16.092158 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-cc756b75-1be4-4175-879f-77fe60a0cf9f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:16.093061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-cc756b75-1be4-4175-879f-77fe60a0cf9f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:16.103626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cc756b75-1be4-4175-879f-77fe60a0cf9f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:16.104445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cc756b75-1be4-4175-879f-77fe60a0cf9f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:16.108337 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cc756b75-1be4-4175-879f-77fe60a0cf9f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:16.108891 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cc756b75-1be4-4175-879f-77fe60a0cf9f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:16.273806 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-cc756b75-1be4-4175-879f-77fe60a0cf9f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:16.281281 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-cc756b75-1be4-4175-879f-77fe60a0cf9f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.196887 Jul 01 07:15:16.281837 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 409/773] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:16 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:16.763703 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:15:16.763931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:15:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:15:16.824052 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e3914ce5-1128-40f0-aa29-017752d6eb1b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:16.824703 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e3914ce5-1128-40f0-aa29-017752d6eb1b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:16.832702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e3914ce5-1128-40f0-aa29-017752d6eb1b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:16.833152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e3914ce5-1128-40f0-aa29-017752d6eb1b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:16.833938 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e3914ce5-1128-40f0-aa29-017752d6eb1b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:16.834377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e3914ce5-1128-40f0-aa29-017752d6eb1b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:16.910042 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e3914ce5-1128-40f0-aa29-017752d6eb1b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:16.917446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e3914ce5-1128-40f0-aa29-017752d6eb1b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1312 microversion: 2.1 time: 0.097260 Jul 01 07:15:16.918043 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 365/774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:16 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:15:17.300670 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-54375056-a6ec-4210-b58f-97c7b64fdd7a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:17.301767 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-54375056-a6ec-4210-b58f-97c7b64fdd7a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:17.305819 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:17.310495 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-54375056-a6ec-4210-b58f-97c7b64fdd7a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:17.311061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-54375056-a6ec-4210-b58f-97c7b64fdd7a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:17.312098 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-54375056-a6ec-4210-b58f-97c7b64fdd7a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:17.312736 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-54375056-a6ec-4210-b58f-97c7b64fdd7a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:17.539152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-54375056-a6ec-4210-b58f-97c7b64fdd7a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:17.546711 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-54375056-a6ec-4210-b58f-97c7b64fdd7a tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.251611 Jul 01 07:15:17.547313 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 410/775] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:17 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:17.934825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a5a8b1a7-e251-4793-90d4-b4426fde5e97 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:17.935356 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a5a8b1a7-e251-4793-90d4-b4426fde5e97 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:17.941754 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a5a8b1a7-e251-4793-90d4-b4426fde5e97 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:17.942227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a5a8b1a7-e251-4793-90d4-b4426fde5e97 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:17.943003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a5a8b1a7-e251-4793-90d4-b4426fde5e97 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:17.943432 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a5a8b1a7-e251-4793-90d4-b4426fde5e97 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:18.148672 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a5a8b1a7-e251-4793-90d4-b4426fde5e97 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:18.156031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a5a8b1a7-e251-4793-90d4-b4426fde5e97 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1368 microversion: 2.1 time: 0.225484 Jul 01 07:15:18.156605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 366/776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:17 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:18.406921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-1b7996da-b63c-4c72-82b3-5e1f3ff77dfb req-b4116b79-a73f-4cd6-8af4-8dece93a2083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55170f1a-b683-46b7-955c-60a9344796e2", "tag": "a8468059-7832-44f4-a4d0-9c2bd31379e3"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:18.420011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-1b7996da-b63c-4c72-82b3-5e1f3ff77dfb req-b4116b79-a73f-4cd6-8af4-8dece93a2083 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:18.420457 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-1b7996da-b63c-4c72-82b3-5e1f3ff77dfb req-b4116b79-a73f-4cd6-8af4-8dece93a2083 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:18.436351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-1b7996da-b63c-4c72-82b3-5e1f3ff77dfb req-b4116b79-a73f-4cd6-8af4-8dece93a2083 service nova] Creating event network-changed:a8468059-7832-44f4-a4d0-9c2bd31379e3 for instance 55170f1a-b683-46b7-955c-60a9344796e2 on hv-cinder-80721 Jul 01 07:15:18.444581 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-1b7996da-b63c-4c72-82b3-5e1f3ff77dfb req-b4116b79-a73f-4cd6-8af4-8dece93a2083 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041842 Jul 01 07:15:18.445817 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 411/777] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:18.565888 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0a3f7d7c-a3d8-461b-9bcb-354785be808d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:18.567019 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0a3f7d7c-a3d8-461b-9bcb-354785be808d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:18.575993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0a3f7d7c-a3d8-461b-9bcb-354785be808d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:18.576670 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0a3f7d7c-a3d8-461b-9bcb-354785be808d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:18.577783 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0a3f7d7c-a3d8-461b-9bcb-354785be808d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:18.578369 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0a3f7d7c-a3d8-461b-9bcb-354785be808d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:18.793875 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0a3f7d7c-a3d8-461b-9bcb-354785be808d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:18.801487 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0a3f7d7c-a3d8-461b-9bcb-354785be808d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.240762 Jul 01 07:15:18.802064 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 367/778] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:18 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:15:19.173920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-43f8ce52-5550-447f-9389-c9fa34c593b8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:19.174729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-43f8ce52-5550-447f-9389-c9fa34c593b8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:19.181472 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43f8ce52-5550-447f-9389-c9fa34c593b8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:19.181916 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43f8ce52-5550-447f-9389-c9fa34c593b8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:19.182680 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43f8ce52-5550-447f-9389-c9fa34c593b8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:19.183137 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43f8ce52-5550-447f-9389-c9fa34c593b8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:19.381234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-43f8ce52-5550-447f-9389-c9fa34c593b8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:19.388525 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-43f8ce52-5550-447f-9389-c9fa34c593b8 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1368 microversion: 2.1 time: 0.218775 Jul 01 07:15:19.389081 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 412/779] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:19 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:19.819329 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f9980754-45be-4c63-8cd5-9885b713316d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:19.819895 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f9980754-45be-4c63-8cd5-9885b713316d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:19.826404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f9980754-45be-4c63-8cd5-9885b713316d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:19.827003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f9980754-45be-4c63-8cd5-9885b713316d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:19.827768 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f9980754-45be-4c63-8cd5-9885b713316d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:19.828204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f9980754-45be-4c63-8cd5-9885b713316d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:19.957412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f9980754-45be-4c63-8cd5-9885b713316d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:19.964873 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f9980754-45be-4c63-8cd5-9885b713316d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.149485 Jul 01 07:15:19.965428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 368/780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:19 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:20.405066 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1699b10d-b3c2-496c-a018-a47fdf55ff55 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:20.405654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1699b10d-b3c2-496c-a018-a47fdf55ff55 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:20.412985 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1699b10d-b3c2-496c-a018-a47fdf55ff55 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:20.413445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1699b10d-b3c2-496c-a018-a47fdf55ff55 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:20.414214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1699b10d-b3c2-496c-a018-a47fdf55ff55 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:20.414658 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1699b10d-b3c2-496c-a018-a47fdf55ff55 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:20.546610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1699b10d-b3c2-496c-a018-a47fdf55ff55 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:20.553862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1699b10d-b3c2-496c-a018-a47fdf55ff55 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1368 microversion: 2.1 time: 0.152688 Jul 01 07:15:20.554419 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 413/781] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:20 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:20.982324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7014984b-8252-4aee-92bc-549241209ea0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:20.982962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7014984b-8252-4aee-92bc-549241209ea0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:20.990027 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7014984b-8252-4aee-92bc-549241209ea0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:20.990472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7014984b-8252-4aee-92bc-549241209ea0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:20.991261 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7014984b-8252-4aee-92bc-549241209ea0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:20.991691 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7014984b-8252-4aee-92bc-549241209ea0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:21.121906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7014984b-8252-4aee-92bc-549241209ea0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:21.130003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7014984b-8252-4aee-92bc-549241209ea0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.151432 Jul 01 07:15:21.130568 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 369/782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:20 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:21.571210 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2b51bd99-8ad2-4911-b842-7c97cc0ff69f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:21.571745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2b51bd99-8ad2-4911-b842-7c97cc0ff69f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:21.578198 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b51bd99-8ad2-4911-b842-7c97cc0ff69f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:21.578651 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b51bd99-8ad2-4911-b842-7c97cc0ff69f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:21.579448 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b51bd99-8ad2-4911-b842-7c97cc0ff69f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:21.579890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2b51bd99-8ad2-4911-b842-7c97cc0ff69f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:21.759145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2b51bd99-8ad2-4911-b842-7c97cc0ff69f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:21.766637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2b51bd99-8ad2-4911-b842-7c97cc0ff69f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1368 microversion: 2.1 time: 0.199308 Jul 01 07:15:21.767496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 414/783] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:21 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:22.147197 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f1e5b105-0751-4d09-9804-d9ff824c6fc3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:22.147829 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f1e5b105-0751-4d09-9804-d9ff824c6fc3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:22.154180 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f1e5b105-0751-4d09-9804-d9ff824c6fc3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:22.154624 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f1e5b105-0751-4d09-9804-d9ff824c6fc3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:22.155424 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f1e5b105-0751-4d09-9804-d9ff824c6fc3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:22.155858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f1e5b105-0751-4d09-9804-d9ff824c6fc3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:22.286985 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f1e5b105-0751-4d09-9804-d9ff824c6fc3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:22.294331 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f1e5b105-0751-4d09-9804-d9ff824c6fc3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.151039 Jul 01 07:15:22.295100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 370/784] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:22 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:22.783091 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9b5665db-a634-48be-b7b5-519912e7d9de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:22.783745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9b5665db-a634-48be-b7b5-519912e7d9de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:22.790206 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9b5665db-a634-48be-b7b5-519912e7d9de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:22.790642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9b5665db-a634-48be-b7b5-519912e7d9de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:22.791434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9b5665db-a634-48be-b7b5-519912e7d9de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:22.791871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9b5665db-a634-48be-b7b5-519912e7d9de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:22.920707 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9b5665db-a634-48be-b7b5-519912e7d9de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:22.928596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9b5665db-a634-48be-b7b5-519912e7d9de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1368 microversion: 2.1 time: 0.149275 Jul 01 07:15:22.929159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 415/785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:22 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:23.313033 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a48e85aa-5410-4ab9-8e8a-c4765ce486f8 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:23.313538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a48e85aa-5410-4ab9-8e8a-c4765ce486f8 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:23.319988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a48e85aa-5410-4ab9-8e8a-c4765ce486f8 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:23.320433 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a48e85aa-5410-4ab9-8e8a-c4765ce486f8 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:23.321398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a48e85aa-5410-4ab9-8e8a-c4765ce486f8 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:23.321830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a48e85aa-5410-4ab9-8e8a-c4765ce486f8 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:23.373564 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-06ef14ad-47d1-48be-9e01-abaee64fa6ac req-feec74aa-234a-4130-a2d5-4f6266ab671b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55170f1a-b683-46b7-955c-60a9344796e2", "name": "network-vif-plugged", "status": "completed", "tag": "a8468059-7832-44f4-a4d0-9c2bd31379e3"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:23.382416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-06ef14ad-47d1-48be-9e01-abaee64fa6ac req-feec74aa-234a-4130-a2d5-4f6266ab671b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:23.382888 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-06ef14ad-47d1-48be-9e01-abaee64fa6ac req-feec74aa-234a-4130-a2d5-4f6266ab671b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:23.394180 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-06ef14ad-47d1-48be-9e01-abaee64fa6ac req-feec74aa-234a-4130-a2d5-4f6266ab671b service nova] Creating event network-vif-plugged:a8468059-7832-44f4-a4d0-9c2bd31379e3 for instance 55170f1a-b683-46b7-955c-60a9344796e2 on hv-cinder-80721 Jul 01 07:15:23.398932 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-06ef14ad-47d1-48be-9e01-abaee64fa6ac req-feec74aa-234a-4130-a2d5-4f6266ab671b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218472 Jul 01 07:15:23.399577 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 371/786] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:23.452735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a48e85aa-5410-4ab9-8e8a-c4765ce486f8 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:23.461100 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a48e85aa-5410-4ab9-8e8a-c4765ce486f8 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.152259 Jul 01 07:15:23.461671 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 416/787] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:23 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:15:23.946116 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2b782d5d-0ecd-4d11-896d-2edabf3b70e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:23.946754 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2b782d5d-0ecd-4d11-896d-2edabf3b70e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:23.953995 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2b782d5d-0ecd-4d11-896d-2edabf3b70e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:23.954514 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2b782d5d-0ecd-4d11-896d-2edabf3b70e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:23.956065 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2b782d5d-0ecd-4d11-896d-2edabf3b70e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:23.956307 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2b782d5d-0ecd-4d11-896d-2edabf3b70e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:24.093677 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2b782d5d-0ecd-4d11-896d-2edabf3b70e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:24.101808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2b782d5d-0ecd-4d11-896d-2edabf3b70e7 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1368 microversion: 2.1 time: 0.160045 Jul 01 07:15:24.102362 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 372/788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:23 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:24.478165 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f6248ed6-a7c0-4e28-9b81-7640fa1017d1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:24.478699 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f6248ed6-a7c0-4e28-9b81-7640fa1017d1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:24.485170 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f6248ed6-a7c0-4e28-9b81-7640fa1017d1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:24.485618 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f6248ed6-a7c0-4e28-9b81-7640fa1017d1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:24.486415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f6248ed6-a7c0-4e28-9b81-7640fa1017d1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:24.486878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f6248ed6-a7c0-4e28-9b81-7640fa1017d1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:24.501474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:24.622624 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f6248ed6-a7c0-4e28-9b81-7640fa1017d1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:24.630582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f6248ed6-a7c0-4e28-9b81-7640fa1017d1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.156400 Jul 01 07:15:24.631178 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 417/789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:24 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:25.118872 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c338ec07-8c31-4527-aee5-e34cf7cf1234 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:25.119483 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c338ec07-8c31-4527-aee5-e34cf7cf1234 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:25.125943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c338ec07-8c31-4527-aee5-e34cf7cf1234 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:25.126387 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c338ec07-8c31-4527-aee5-e34cf7cf1234 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:25.127182 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c338ec07-8c31-4527-aee5-e34cf7cf1234 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:25.127620 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c338ec07-8c31-4527-aee5-e34cf7cf1234 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:25.258898 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c338ec07-8c31-4527-aee5-e34cf7cf1234 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:25.267999 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c338ec07-8c31-4527-aee5-e34cf7cf1234 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1368 microversion: 2.1 time: 0.152954 Jul 01 07:15:25.268799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 373/790] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:25 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:25.648301 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0e4ee192-6b61-4b49-b6e1-f45fe2b9425f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:25.648912 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0e4ee192-6b61-4b49-b6e1-f45fe2b9425f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:25.655481 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0e4ee192-6b61-4b49-b6e1-f45fe2b9425f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:25.655932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0e4ee192-6b61-4b49-b6e1-f45fe2b9425f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:25.656702 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0e4ee192-6b61-4b49-b6e1-f45fe2b9425f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:25.657142 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0e4ee192-6b61-4b49-b6e1-f45fe2b9425f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:25.672493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:25.688081 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=6 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:25.846300 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0e4ee192-6b61-4b49-b6e1-f45fe2b9425f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:25.853930 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0e4ee192-6b61-4b49-b6e1-f45fe2b9425f tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.209640 Jul 01 07:15:25.854496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 418/791] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:25 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:26.285249 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-61692a78-e8dc-4d76-9590-7e6f32362a6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:26.285851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-61692a78-e8dc-4d76-9590-7e6f32362a6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:26.287786 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=6 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:26.293666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-61692a78-e8dc-4d76-9590-7e6f32362a6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:26.294113 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-61692a78-e8dc-4d76-9590-7e6f32362a6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:26.294954 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-61692a78-e8dc-4d76-9590-7e6f32362a6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:26.295389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-61692a78-e8dc-4d76-9590-7e6f32362a6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:26.423606 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-61692a78-e8dc-4d76-9590-7e6f32362a6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:26.431055 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-61692a78-e8dc-4d76-9590-7e6f32362a6d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1559 microversion: 2.1 time: 0.150279 Jul 01 07:15:26.431618 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 374/792] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:26 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:26.447169 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4a82cd87-1163-4fe1-9002-0c9a2922b4b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:26.447657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4a82cd87-1163-4fe1-9002-0c9a2922b4b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:26.453582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4a82cd87-1163-4fe1-9002-0c9a2922b4b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:26.454246 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4a82cd87-1163-4fe1-9002-0c9a2922b4b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:26.455544 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4a82cd87-1163-4fe1-9002-0c9a2922b4b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:26.455977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4a82cd87-1163-4fe1-9002-0c9a2922b4b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:26.540453 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4a82cd87-1163-4fe1-9002-0c9a2922b4b0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097075 Jul 01 07:15:26.541056 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 419/793] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jul 1 07:15:26 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:26.871119 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6ce61d46-253d-4a63-8fbd-4a5aacfdfdb9 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:26.871826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6ce61d46-253d-4a63-8fbd-4a5aacfdfdb9 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:26.878515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6ce61d46-253d-4a63-8fbd-4a5aacfdfdb9 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:26.879002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6ce61d46-253d-4a63-8fbd-4a5aacfdfdb9 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:26.879826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6ce61d46-253d-4a63-8fbd-4a5aacfdfdb9 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:26.880282 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6ce61d46-253d-4a63-8fbd-4a5aacfdfdb9 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:27.282939 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6ce61d46-253d-4a63-8fbd-4a5aacfdfdb9 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:27.291180 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6ce61d46-253d-4a63-8fbd-4a5aacfdfdb9 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.423880 Jul 01 07:15:27.291996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 375/794] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:26 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:27.730918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-e4032d37-151c-48af-9eb4-af3f9a70fbcd req-656e3e39-2257-430a-a3bc-096d900335a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55170f1a-b683-46b7-955c-60a9344796e2", "tag": "a8468059-7832-44f4-a4d0-9c2bd31379e3"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:27.739215 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-e4032d37-151c-48af-9eb4-af3f9a70fbcd req-656e3e39-2257-430a-a3bc-096d900335a4 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:27.739658 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-e4032d37-151c-48af-9eb4-af3f9a70fbcd req-656e3e39-2257-430a-a3bc-096d900335a4 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:27.750347 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-e4032d37-151c-48af-9eb4-af3f9a70fbcd req-656e3e39-2257-430a-a3bc-096d900335a4 service nova] Creating event network-changed:a8468059-7832-44f4-a4d0-9c2bd31379e3 for instance 55170f1a-b683-46b7-955c-60a9344796e2 on hv-cinder-80721 Jul 01 07:15:27.755413 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-e4032d37-151c-48af-9eb4-af3f9a70fbcd req-656e3e39-2257-430a-a3bc-096d900335a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028647 Jul 01 07:15:27.756022 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 420/795] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:28.308967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-973584c8-668b-4741-b5a8-70398b18ab31 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:28.310479 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-973584c8-668b-4741-b5a8-70398b18ab31 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:28.313719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:28.320909 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-973584c8-668b-4741-b5a8-70398b18ab31 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:28.321694 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-973584c8-668b-4741-b5a8-70398b18ab31 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:28.322701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-973584c8-668b-4741-b5a8-70398b18ab31 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:28.323387 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-973584c8-668b-4741-b5a8-70398b18ab31 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:28.520550 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-973584c8-668b-4741-b5a8-70398b18ab31 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:28.531632 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-973584c8-668b-4741-b5a8-70398b18ab31 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.226403 Jul 01 07:15:28.532217 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 376/796] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:28 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:29.550010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-10b8b60b-8399-4fcd-b837-40a6eb705536 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:29.551100 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-10b8b60b-8399-4fcd-b837-40a6eb705536 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:29.556761 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-10b8b60b-8399-4fcd-b837-40a6eb705536 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:29.557215 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-10b8b60b-8399-4fcd-b837-40a6eb705536 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:29.557970 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-10b8b60b-8399-4fcd-b837-40a6eb705536 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:29.558400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-10b8b60b-8399-4fcd-b837-40a6eb705536 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:29.691569 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-10b8b60b-8399-4fcd-b837-40a6eb705536 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:29.698965 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-10b8b60b-8399-4fcd-b837-40a6eb705536 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1509 microversion: 2.1 time: 0.154286 Jul 01 07:15:29.699531 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 421/797] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:29 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:29.715087 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-629738b2-652e-45c5-a879-f2d13a3f3e56 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:29.715650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-629738b2-652e-45c5-a879-f2d13a3f3e56 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:29.722469 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-629738b2-652e-45c5-a879-f2d13a3f3e56 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:29.722951 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-629738b2-652e-45c5-a879-f2d13a3f3e56 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:29.723705 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-629738b2-652e-45c5-a879-f2d13a3f3e56 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:29.724134 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-629738b2-652e-45c5-a879-f2d13a3f3e56 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:29.910736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-629738b2-652e-45c5-a879-f2d13a3f3e56 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "POST /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7/action" status: 202 len: 0 microversion: 2.1 time: 0.199460 Jul 01 07:15:29.911362 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 377/798] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:15:29 2022] POST /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:15:29.919185 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-71cc55d2-2098-4d12-b747-a0330821ea94 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:29.919791 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-71cc55d2-2098-4d12-b747-a0330821ea94 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:29.926167 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-71cc55d2-2098-4d12-b747-a0330821ea94 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:29.926610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-71cc55d2-2098-4d12-b747-a0330821ea94 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:29.927391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-71cc55d2-2098-4d12-b747-a0330821ea94 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:29.927822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-71cc55d2-2098-4d12-b747-a0330821ea94 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:30.063658 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-71cc55d2-2098-4d12-b747-a0330821ea94 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:30.071730 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-71cc55d2-2098-4d12-b747-a0330821ea94 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1517 microversion: 2.1 time: 0.156293 Jul 01 07:15:30.072452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 422/799] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:29 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:31.089779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-863d47f8-a568-41ef-b559-bae070abec92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:31.090388 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-863d47f8-a568-41ef-b559-bae070abec92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:31.096376 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-863d47f8-a568-41ef-b559-bae070abec92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:31.096817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-863d47f8-a568-41ef-b559-bae070abec92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:31.097600 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-863d47f8-a568-41ef-b559-bae070abec92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:31.098031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-863d47f8-a568-41ef-b559-bae070abec92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:31.177896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-c6325864-6808-47bf-8bd4-781f57bf39b4 req-0279cd44-e74b-4f52-9d7f-8728612206eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456ae774-27ea-4a7a-a785-7b0f83ffa4b7", "name": "network-vif-unplugged", "status": "completed", "tag": "6cada016-8f00-4c9f-903c-e0d5b5b84f89"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:31.194451 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-c6325864-6808-47bf-8bd4-781f57bf39b4 req-0279cd44-e74b-4f52-9d7f-8728612206eb service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:31.195369 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-c6325864-6808-47bf-8bd4-781f57bf39b4 req-0279cd44-e74b-4f52-9d7f-8728612206eb service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:31.208812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.compute.server_external_events [req-c6325864-6808-47bf-8bd4-781f57bf39b4 req-0279cd44-e74b-4f52-9d7f-8728612206eb service nova] Unable to find a host for instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7. Dropping event network-vif-unplugged {{(pid=117835) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 07:15:31.210105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-c6325864-6808-47bf-8bd4-781f57bf39b4 req-0279cd44-e74b-4f52-9d7f-8728612206eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036520 Jul 01 07:15:31.211196 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 423/800] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 01 07:15:31.238615 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-863d47f8-a568-41ef-b559-bae070abec92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:31.246196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-863d47f8-a568-41ef-b559-bae070abec92 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1519 microversion: 2.1 time: 0.160639 Jul 01 07:15:31.246791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 378/801] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:31 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:32.264595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-91579cd9-40dd-4539-a6ff-bad5ef570dc2 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:32.265210 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-91579cd9-40dd-4539-a6ff-bad5ef570dc2 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:32.272327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-91579cd9-40dd-4539-a6ff-bad5ef570dc2 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:32.272810 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-91579cd9-40dd-4539-a6ff-bad5ef570dc2 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:32.273890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-91579cd9-40dd-4539-a6ff-bad5ef570dc2 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:32.274222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-91579cd9-40dd-4539-a6ff-bad5ef570dc2 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:32.479787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-91579cd9-40dd-4539-a6ff-bad5ef570dc2 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:32.487331 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-91579cd9-40dd-4539-a6ff-bad5ef570dc2 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.226871 Jul 01 07:15:32.487905 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 424/802] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:32 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:33.504596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-789bd2a2-437d-4fd8-b103-1a4b35a90ec6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:33.505134 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-789bd2a2-437d-4fd8-b103-1a4b35a90ec6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:33.511191 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-789bd2a2-437d-4fd8-b103-1a4b35a90ec6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:33.511637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-789bd2a2-437d-4fd8-b103-1a4b35a90ec6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:33.512387 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-789bd2a2-437d-4fd8-b103-1a4b35a90ec6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:33.512816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-789bd2a2-437d-4fd8-b103-1a4b35a90ec6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:33.641643 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-789bd2a2-437d-4fd8-b103-1a4b35a90ec6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:33.645567 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:33.650277 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-789bd2a2-437d-4fd8-b103-1a4b35a90ec6 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.149784 Jul 01 07:15:33.650855 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 379/803] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:33 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:34.667851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-20776abf-a895-4b0f-b490-640369e5e4d3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:34.668467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-20776abf-a895-4b0f-b490-640369e5e4d3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:34.675040 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-20776abf-a895-4b0f-b490-640369e5e4d3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:34.675487 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-20776abf-a895-4b0f-b490-640369e5e4d3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:34.676239 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-20776abf-a895-4b0f-b490-640369e5e4d3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:34.676666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-20776abf-a895-4b0f-b490-640369e5e4d3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:34.803483 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-20776abf-a895-4b0f-b490-640369e5e4d3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:34.811168 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-20776abf-a895-4b0f-b490-640369e5e4d3 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.147026 Jul 01 07:15:34.811738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 425/804] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:34 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:35.829012 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-403b61fc-5aa1-478d-b33c-4745ad5fe222 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:35.830399 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-403b61fc-5aa1-478d-b33c-4745ad5fe222 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:35.837947 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-403b61fc-5aa1-478d-b33c-4745ad5fe222 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:35.838389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-403b61fc-5aa1-478d-b33c-4745ad5fe222 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:35.839173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-403b61fc-5aa1-478d-b33c-4745ad5fe222 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:35.839607 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-403b61fc-5aa1-478d-b33c-4745ad5fe222 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:35.966971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-403b61fc-5aa1-478d-b33c-4745ad5fe222 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:35.974382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-403b61fc-5aa1-478d-b33c-4745ad5fe222 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.149344 Jul 01 07:15:35.974964 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 380/805] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:35 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:36.991605 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7065b0a3-0cee-403b-b642-ec1ef2557304 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:36.992210 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7065b0a3-0cee-403b-b642-ec1ef2557304 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:36.998269 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7065b0a3-0cee-403b-b642-ec1ef2557304 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:36.998712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7065b0a3-0cee-403b-b642-ec1ef2557304 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:36.999504 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7065b0a3-0cee-403b-b642-ec1ef2557304 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:36.999939 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7065b0a3-0cee-403b-b642-ec1ef2557304 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:37.132627 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7065b0a3-0cee-403b-b642-ec1ef2557304 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:37.140107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7065b0a3-0cee-403b-b642-ec1ef2557304 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.152537 Jul 01 07:15:37.140660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 426/806] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:36 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:38.157324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fbc9619c-4fb8-4e16-9eb1-61672b94c521 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:38.158547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fbc9619c-4fb8-4e16-9eb1-61672b94c521 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:38.165021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbc9619c-4fb8-4e16-9eb1-61672b94c521 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:38.165462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbc9619c-4fb8-4e16-9eb1-61672b94c521 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:38.166208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbc9619c-4fb8-4e16-9eb1-61672b94c521 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:38.166636 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fbc9619c-4fb8-4e16-9eb1-61672b94c521 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:38.293228 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fbc9619c-4fb8-4e16-9eb1-61672b94c521 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:38.300555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fbc9619c-4fb8-4e16-9eb1-61672b94c521 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.147119 Jul 01 07:15:38.301114 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 381/807] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:38 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:39.318132 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-33cd0089-00df-4785-80c2-30b5cc553374 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:39.318757 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-33cd0089-00df-4785-80c2-30b5cc553374 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:39.325263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-33cd0089-00df-4785-80c2-30b5cc553374 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:39.325711 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-33cd0089-00df-4785-80c2-30b5cc553374 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:39.326464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-33cd0089-00df-4785-80c2-30b5cc553374 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:39.326928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-33cd0089-00df-4785-80c2-30b5cc553374 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:39.465507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-33cd0089-00df-4785-80c2-30b5cc553374 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:39.473111 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-33cd0089-00df-4785-80c2-30b5cc553374 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.159319 Jul 01 07:15:39.473686 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 427/808] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:39 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:40.489207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-259de641-dd99-4bf8-b1be-3f6e979033a1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:40.489812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-259de641-dd99-4bf8-b1be-3f6e979033a1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:40.496384 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-259de641-dd99-4bf8-b1be-3f6e979033a1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:40.496833 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-259de641-dd99-4bf8-b1be-3f6e979033a1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:40.497586 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-259de641-dd99-4bf8-b1be-3f6e979033a1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:40.498014 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-259de641-dd99-4bf8-b1be-3f6e979033a1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:40.631498 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-259de641-dd99-4bf8-b1be-3f6e979033a1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:40.638910 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-259de641-dd99-4bf8-b1be-3f6e979033a1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.153455 Jul 01 07:15:40.639472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 382/809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:40 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:41.656289 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-453d5248-1f56-4ebd-8cb4-3c139639ea35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:41.656898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-453d5248-1f56-4ebd-8cb4-3c139639ea35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:41.663272 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-453d5248-1f56-4ebd-8cb4-3c139639ea35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:41.663718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-453d5248-1f56-4ebd-8cb4-3c139639ea35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:41.664471 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-453d5248-1f56-4ebd-8cb4-3c139639ea35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:41.664914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-453d5248-1f56-4ebd-8cb4-3c139639ea35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:41.795234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-453d5248-1f56-4ebd-8cb4-3c139639ea35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:41.802706 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-453d5248-1f56-4ebd-8cb4-3c139639ea35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.150263 Jul 01 07:15:41.803302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 428/810] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:41 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:42.330637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-761724d5-a126-4fc8-bd4c-a9d93c12849e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:42.331231 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-761724d5-a126-4fc8-bd4c-a9d93c12849e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:42.337611 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-761724d5-a126-4fc8-bd4c-a9d93c12849e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:42.338056 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-761724d5-a126-4fc8-bd4c-a9d93c12849e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:42.338838 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-761724d5-a126-4fc8-bd4c-a9d93c12849e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:42.339275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-761724d5-a126-4fc8-bd4c-a9d93c12849e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:42.367651 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-761724d5-a126-4fc8-bd4c-a9d93c12849e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments/0111bfda-40ac-4767-a473-a7b6d81a78e7" status: 200 len: 194 microversion: 2.20 time: 0.041113 Jul 01 07:15:42.368208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 383/811] 10.222.0.48 () {60 vars in 1453 bytes} [Fri Jul 1 07:15:42 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments/0111bfda-40ac-4767-a473-a7b6d81a78e7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:15:42.428752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0ad5cb16-b852-4cc0-a753-68db93fd32c6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:42.429239 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0ad5cb16-b852-4cc0-a753-68db93fd32c6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:42.435419 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0ad5cb16-b852-4cc0-a753-68db93fd32c6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:42.435867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0ad5cb16-b852-4cc0-a753-68db93fd32c6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:42.436618 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0ad5cb16-b852-4cc0-a753-68db93fd32c6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:42.437048 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0ad5cb16-b852-4cc0-a753-68db93fd32c6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:42.514713 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-0ad5cb16-b852-4cc0-a753-68db93fd32c6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lazy-loading 'services' on Instance uuid 06e3db32-ed35-4c27-ad2f-30bfbe556c25 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:15:42.586687 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0ad5cb16-b852-4cc0-a753-68db93fd32c6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments/0111bfda-40ac-4767-a473-a7b6d81a78e7" status: 202 len: 0 microversion: 2.20 time: 0.161746 Jul 01 07:15:42.587319 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 429/812] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jul 1 07:15:42 2022] DELETE /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments/0111bfda-40ac-4767-a473-a7b6d81a78e7 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:15:42.596227 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d13f76f0-5063-4826-9cdb-6e50ee174dd5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:42.597199 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d13f76f0-5063-4826-9cdb-6e50ee174dd5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:42.603800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d13f76f0-5063-4826-9cdb-6e50ee174dd5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:42.604257 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d13f76f0-5063-4826-9cdb-6e50ee174dd5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:42.605002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d13f76f0-5063-4826-9cdb-6e50ee174dd5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:42.605440 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d13f76f0-5063-4826-9cdb-6e50ee174dd5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:42.634691 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d13f76f0-5063-4826-9cdb-6e50ee174dd5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042910 Jul 01 07:15:42.635276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 384/813] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jul 1 07:15:42 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:15:42.821151 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b3262423-e836-432b-bf6e-336e2bd5b3c0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:42.822427 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b3262423-e836-432b-bf6e-336e2bd5b3c0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:42.834033 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b3262423-e836-432b-bf6e-336e2bd5b3c0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:42.834481 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b3262423-e836-432b-bf6e-336e2bd5b3c0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:42.835298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b3262423-e836-432b-bf6e-336e2bd5b3c0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:42.835732 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b3262423-e836-432b-bf6e-336e2bd5b3c0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:42.967342 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b3262423-e836-432b-bf6e-336e2bd5b3c0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:42.975472 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b3262423-e836-432b-bf6e-336e2bd5b3c0 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.158932 Jul 01 07:15:42.976035 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 430/814] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:42 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:43.646070 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-aca15432-e60f-45c3-bcaa-341c89b8317d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:43.647004 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-aca15432-e60f-45c3-bcaa-341c89b8317d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:43.653443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-aca15432-e60f-45c3-bcaa-341c89b8317d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:43.653884 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-aca15432-e60f-45c3-bcaa-341c89b8317d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:43.654639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-aca15432-e60f-45c3-bcaa-341c89b8317d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:43.655100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-aca15432-e60f-45c3-bcaa-341c89b8317d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:43.683930 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-aca15432-e60f-45c3-bcaa-341c89b8317d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042270 Jul 01 07:15:43.684737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 385/815] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jul 1 07:15:43 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:43.742372 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-066260fa-4b19-4bb3-b486-68adef8b3956 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:43.742900 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-066260fa-4b19-4bb3-b486-68adef8b3956 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:43.748986 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-066260fa-4b19-4bb3-b486-68adef8b3956 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:43.749444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-066260fa-4b19-4bb3-b486-68adef8b3956 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:43.750212 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-066260fa-4b19-4bb3-b486-68adef8b3956 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:43.750650 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-066260fa-4b19-4bb3-b486-68adef8b3956 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:43.775741 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-066260fa-4b19-4bb3-b486-68adef8b3956 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:15:43.849305 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-066260fa-4b19-4bb3-b486-68adef8b3956 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 204 len: 0 microversion: 2.20 time: 0.110374 Jul 01 07:15:43.852931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 431/816] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jul 1 07:15:43 2022] DELETE /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 07:15:43.858279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:43.858991 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:43.865612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:43.866066 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:43.866859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:43.867305 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:43.992977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7dbefff2-bf0f-4ddf-9ff5-3a47ea59dabf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:43.993690 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7dbefff2-bf0f-4ddf-9ff5-3a47ea59dabf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:43.998013 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:44.000202 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7dbefff2-bf0f-4ddf-9ff5-3a47ea59dabf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:44.000880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7dbefff2-bf0f-4ddf-9ff5-3a47ea59dabf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:44.002161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7dbefff2-bf0f-4ddf-9ff5-3a47ea59dabf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:44.002599 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7dbefff2-bf0f-4ddf-9ff5-3a47ea59dabf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:44.006854 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:44.008380 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:44.009549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6d407983-3388-4fd7-b89b-24732bb8d071 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.155571 Jul 01 07:15:44.010107 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 386/817] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:43 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:44.140110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7dbefff2-bf0f-4ddf-9ff5-3a47ea59dabf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:44.147638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7dbefff2-bf0f-4ddf-9ff5-3a47ea59dabf tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.158872 Jul 01 07:15:44.148269 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 432/818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:43 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:15:45.027993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:45.028593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:45.035636 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:45.036076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:45.036823 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:45.037253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:45.168228 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:45.176295 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:45.177786 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:45.178972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-860590cc-5562-4718-8533-2ab58b0b30a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.154827 Jul 01 07:15:45.179531 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 387/819] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:45 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:45.266647 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d5ce7d90-e0a0-4f27-97f2-f9dd47e2757c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:45.267903 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d5ce7d90-e0a0-4f27-97f2-f9dd47e2757c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:45.273907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5ce7d90-e0a0-4f27-97f2-f9dd47e2757c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:45.274351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5ce7d90-e0a0-4f27-97f2-f9dd47e2757c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:45.275145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5ce7d90-e0a0-4f27-97f2-f9dd47e2757c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:45.275577 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5ce7d90-e0a0-4f27-97f2-f9dd47e2757c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:45.292508 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:45.404707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-2a513923-3ac7-42b0-ab40-58ae397d7191 req-9a167d5c-1713-4385-843b-bcfe46646215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456ae774-27ea-4a7a-a785-7b0f83ffa4b7", "name": "network-vif-plugged", "status": "completed", "tag": "6cada016-8f00-4c9f-903c-e0d5b5b84f89"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:45.412443 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d5ce7d90-e0a0-4f27-97f2-f9dd47e2757c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:45.413622 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-2a513923-3ac7-42b0-ab40-58ae397d7191 req-9a167d5c-1713-4385-843b-bcfe46646215 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:45.414285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-2a513923-3ac7-42b0-ab40-58ae397d7191 req-9a167d5c-1713-4385-843b-bcfe46646215 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:45.421363 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d5ce7d90-e0a0-4f27-97f2-f9dd47e2757c tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.259848 Jul 01 07:15:45.422205 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 433/820] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:45 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:15:45.427240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-2a513923-3ac7-42b0-ab40-58ae397d7191 req-9a167d5c-1713-4385-843b-bcfe46646215 service nova] Creating event network-vif-plugged:6cada016-8f00-4c9f-903c-e0d5b5b84f89 for instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 on hv-cinder-80721 Jul 01 07:15:45.432363 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-2a513923-3ac7-42b0-ab40-58ae397d7191 req-9a167d5c-1713-4385-843b-bcfe46646215 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Jul 01 07:15:45.433201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 388/821] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:15:46.197210 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:46.197984 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:46.204564 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:46.205008 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:46.205796 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:46.206224 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:46.440276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2313e3f7-7072-4a0c-8448-6350bb972de1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:46.440970 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2313e3f7-7072-4a0c-8448-6350bb972de1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:46.448065 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2313e3f7-7072-4a0c-8448-6350bb972de1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:46.448513 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2313e3f7-7072-4a0c-8448-6350bb972de1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:46.449310 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2313e3f7-7072-4a0c-8448-6350bb972de1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:46.449744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2313e3f7-7072-4a0c-8448-6350bb972de1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:46.676522 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:46.684829 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:46.686323 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:46.687505 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-77bece1b-bf38-4f88-ba8d-a7573acc0e3e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1725 microversion: 2.20 time: 0.494226 Jul 01 07:15:46.688303 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 434/822] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:46 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1725 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:46.865583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2313e3f7-7072-4a0c-8448-6350bb972de1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:46.873826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2313e3f7-7072-4a0c-8448-6350bb972de1 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.437827 Jul 01 07:15:46.874452 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 389/823] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:46 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:15:47.266030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-ba59cc77-e635-4f33-b6b0-924498faced6 req-3ed8097c-25b2-42bb-b809-9ca24f078687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e3db32-ed35-4c27-ad2f-30bfbe556c25", "name": "network-vif-deleted", "tag": "37b4518e-4b3f-4f6d-9030-a07d10ba59c5"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:47.281119 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-ba59cc77-e635-4f33-b6b0-924498faced6 req-3ed8097c-25b2-42bb-b809-9ca24f078687 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:47.281793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-ba59cc77-e635-4f33-b6b0-924498faced6 req-3ed8097c-25b2-42bb-b809-9ca24f078687 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:47.292975 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-ba59cc77-e635-4f33-b6b0-924498faced6 req-3ed8097c-25b2-42bb-b809-9ca24f078687 service nova] Creating event network-vif-deleted:37b4518e-4b3f-4f6d-9030-a07d10ba59c5 for instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 on hv-cinder-80721 Jul 01 07:15:47.298667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-ba59cc77-e635-4f33-b6b0-924498faced6 req-3ed8097c-25b2-42bb-b809-9ca24f078687 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047407 Jul 01 07:15:47.299717 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 435/824] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:47.706612 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:47.707515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:47.713908 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:47.714355 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:47.715136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:47.715570 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:47.746703 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:47.747230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:47.747682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lazy-loading 'fault' on Instance uuid 06e3db32-ed35-4c27-ad2f-30bfbe556c25 {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:15:47.788174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:47.796773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:47.798883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:47.800033 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-619e3775-0894-4c92-82d3-67143305d610 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 200 len: 1372 microversion: 2.20 time: 0.097646 Jul 01 07:15:47.800589 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 390/825] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:47 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:47.892393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6d030dce-c2da-4ada-a90b-dc354de2fdea tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:47.893226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6d030dce-c2da-4ada-a90b-dc354de2fdea tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:47.895222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:47.901468 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6d030dce-c2da-4ada-a90b-dc354de2fdea tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:47.902035 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6d030dce-c2da-4ada-a90b-dc354de2fdea tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:47.902938 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6d030dce-c2da-4ada-a90b-dc354de2fdea tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:47.903456 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6d030dce-c2da-4ada-a90b-dc354de2fdea tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:48.057946 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6d030dce-c2da-4ada-a90b-dc354de2fdea tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:48.065790 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6d030dce-c2da-4ada-a90b-dc354de2fdea tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1575 microversion: 2.1 time: 0.178292 Jul 01 07:15:48.066348 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 436/826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:47 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:48.817374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:48.817963 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:48.824399 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:48.824844 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:48.825594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:48.826024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:48.840722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] HTTP exception thrown: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Request method failure captured: Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 HTTP/1.1 Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1vK-w0YMEyJsFXUO1s85nj7nnRcaGqzm0Xa-RasQui0144tsAa5fcQtghHVia03_ETFtHGl8E5WFYbE5kzx0UvNXTweh_3hNdGyQnwLrIZNxhVrIStRYvjCj1segX5f5LbBqwM1nmzBeg-qCq5Wpb6JdXFtUH2-dZeqz7ljaN7duM Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:15:48.842321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c0aec4ac096f4f30b7c357db043925fd"}]}] Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 0e8bf7bbabc4432fa88002ea5c1dce4c Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:15:48.844030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '06e3db32-ed35-4c27-ad2f-30bfbe556c25'} Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:15:48.845525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:15:48.847085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:15:48.848468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Returning 404 to user: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:15:48.848468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-09f6cc43-0d4f-458e-b9e6-3ab184eac9ba tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 404 len: 111 microversion: 2.20 time: 0.030176 Jul 01 07:15:48.848468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 391/827] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:48 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:15:48.852873 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ade05bee-8697-4010-b697-5b637d1b7777 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '.version_select at 0x7f2c4a3bf040>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:48.870284 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ade05bee-8697-4010-b697-5b637d1b7777 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501261960" status: 204 len: 0 microversion: 2.20 time: 0.021126 Jul 01 07:15:48.870847 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 437/828] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Jul 1 07:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501261960 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 07:15:49.083739 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1580b385-a9d4-49db-a044-3da2516b9224 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:49.084280 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1580b385-a9d4-49db-a044-3da2516b9224 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:49.090271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1580b385-a9d4-49db-a044-3da2516b9224 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:49.090722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1580b385-a9d4-49db-a044-3da2516b9224 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:49.091517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1580b385-a9d4-49db-a044-3da2516b9224 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:49.091998 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1580b385-a9d4-49db-a044-3da2516b9224 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:49.227448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1580b385-a9d4-49db-a044-3da2516b9224 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:49.235017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1580b385-a9d4-49db-a044-3da2516b9224 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1562 microversion: 2.1 time: 0.155843 Jul 01 07:15:49.236161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 392/829] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:49 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:49.514178 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-28aa893f-50b1-4991-b5fe-e6076f5ec04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'create', calling method: .version_select at 0x7f2c4a3dd160>, body: {"keypair": {"name": "tempest-keypair-1752442586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzcL0C2mLOZQYDM+xGPU93NU+aGBnZLsMgFh3ZvB/vEe7v48MaJUy6GTGpFNmOm+iqmN8yyJ7U20w1w7C05sKvIRmJTPPYfdT8oykXHZjVSaVecpSKgaZWkQQhabw14bA=="}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:49.528088 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-28aa893f-50b1-4991-b5fe-e6076f5ec04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Getting quotas for project c0aec4ac096f4f30b7c357db043925fd. Resources: {'key_pairs'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:15:49.532369 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-28aa893f-50b1-4991-b5fe-e6076f5ec04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Getting quotas for user 0e8bf7bbabc4432fa88002ea5c1dce4c and project c0aec4ac096f4f30b7c357db043925fd. Resources: {'key_pairs'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:15:49.553500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-28aa893f-50b1-4991-b5fe-e6076f5ec04f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043305 Jul 01 07:15:49.554074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 438/830] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jul 1 07:15:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 07:15:50.786699 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-675528586", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15f0fe42-8be6-4370-8ef5-d4c04f6ba242"}], "security_groups": [{"name": "tempest-securitygroup--1967832467"}], "key_name": "tempest-keypair-1752442586", "user_data": "}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:50.884690 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] validate_networks() for [('15f0fe42-8be6-4370-8ef5-d4c04f6ba242', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:15:51.243108 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:15:51.243537 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:15:51.244006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:15:51.244410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:15:51.244816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:15:51.253988 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:51.254433 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:51.255262 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:51.255694 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:51.272403 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Getting quotas for project c0aec4ac096f4f30b7c357db043925fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:15:51.276287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Getting quotas for user 0e8bf7bbabc4432fa88002ea5c1dce4c and project c0aec4ac096f4f30b7c357db043925fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:15:51.287017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:15:51.289223 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:15:51.336823 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e8fbd5bf-68eb-4c08-82a6-34b23721f30a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.554855 Jul 01 07:15:51.337568 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 393/831] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jul 1 07:15:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 01 07:15:51.348108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1900ec8f-0dca-4b6b-b8b1-5018c3a69bb9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:51.348840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1900ec8f-0dca-4b6b-b8b1-5018c3a69bb9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:51.402477 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1900ec8f-0dca-4b6b-b8b1-5018c3a69bb9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:51.409708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1900ec8f-0dca-4b6b-b8b1-5018c3a69bb9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:51.411280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1900ec8f-0dca-4b6b-b8b1-5018c3a69bb9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:51.412368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1900ec8f-0dca-4b6b-b8b1-5018c3a69bb9 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1281 microversion: 2.20 time: 0.068710 Jul 01 07:15:51.413137 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 439/832] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:51 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:52.430564 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:52.431883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:52.438413 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:52.439107 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:52.440070 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:52.440666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:52.525419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:52.533881 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:52.535416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:52.536519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b2a3e301-1bea-4d2a-b0b0-ff1f3c183600 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1341 microversion: 2.20 time: 0.110598 Jul 01 07:15:52.537250 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 394/833] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:52 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1341 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:53.352258 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ddca5db6-9f52-48d3-8a1c-07121c91ee4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:53.352798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ddca5db6-9f52-48d3-8a1c-07121c91ee4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:53.359144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddca5db6-9f52-48d3-8a1c-07121c91ee4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:53.359598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddca5db6-9f52-48d3-8a1c-07121c91ee4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:53.360407 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddca5db6-9f52-48d3-8a1c-07121c91ee4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:53.360850 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddca5db6-9f52-48d3-8a1c-07121c91ee4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:53.447254 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-ddca5db6-9f52-48d3-8a1c-07121c91ee4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lazy-loading 'services' on Instance uuid 0c0721e7-9239-4832-b6dc-329e0682e8c6 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:15:53.518716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ddca5db6-9f52-48d3-8a1c-07121c91ee4b tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments/dd2fdb5a-07ba-43a3-bd52-df1f6512db2d" status: 202 len: 0 microversion: 2.1 time: 0.170090 Jul 01 07:15:53.519329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 440/834] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:15:53 2022] DELETE /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments/dd2fdb5a-07ba-43a3-bd52-df1f6512db2d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:15:53.527641 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8bae2345-6e69-40ea-824e-c3594db1fe58 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:53.528730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8bae2345-6e69-40ea-824e-c3594db1fe58 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:53.536491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8bae2345-6e69-40ea-824e-c3594db1fe58 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:53.537489 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8bae2345-6e69-40ea-824e-c3594db1fe58 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:53.538405 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8bae2345-6e69-40ea-824e-c3594db1fe58 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:53.539190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8bae2345-6e69-40ea-824e-c3594db1fe58 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:53.554654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:53.555389 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:53.562734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:53.563214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:53.564516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:53.564952 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:53.590131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8bae2345-6e69-40ea-824e-c3594db1fe58 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066354 Jul 01 07:15:53.590625 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 395/835] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:15:53 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:53.794877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:53.804033 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:53.805626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:53.806994 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2eb71c97-c3cc-43ad-9b43-1803e7ca2480 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.256635 Jul 01 07:15:53.807596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 441/836] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:53 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:15:53.982945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-1f62c9f1-59e3-4326-a98e-9add4d08c1f1 req-cb665e21-61c7-402d-9519-ffad0d45b902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cecf2b-81c9-42be-9f7c-a2b9c74f1d76", "tag": "124d2096-5c39-4eaf-8073-f7d321f44142"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:53.990967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-1f62c9f1-59e3-4326-a98e-9add4d08c1f1 req-cb665e21-61c7-402d-9519-ffad0d45b902 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:53.991602 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-1f62c9f1-59e3-4326-a98e-9add4d08c1f1 req-cb665e21-61c7-402d-9519-ffad0d45b902 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:54.002949 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-1f62c9f1-59e3-4326-a98e-9add4d08c1f1 req-cb665e21-61c7-402d-9519-ffad0d45b902 service nova] Creating event network-changed:124d2096-5c39-4eaf-8073-f7d321f44142 for instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 on hv-cinder-80721 Jul 01 07:15:54.007995 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-1f62c9f1-59e3-4326-a98e-9add4d08c1f1 req-cb665e21-61c7-402d-9519-ffad0d45b902 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028522 Jul 01 07:15:54.008743 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 396/837] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:15:54.602030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0729eaf0-a251-4a0b-8217-53f964c41f82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:54.603039 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0729eaf0-a251-4a0b-8217-53f964c41f82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:54.609565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0729eaf0-a251-4a0b-8217-53f964c41f82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:54.610408 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0729eaf0-a251-4a0b-8217-53f964c41f82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:54.611740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0729eaf0-a251-4a0b-8217-53f964c41f82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:54.612346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0729eaf0-a251-4a0b-8217-53f964c41f82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:54.643851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0729eaf0-a251-4a0b-8217-53f964c41f82 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045611 Jul 01 07:15:54.644343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 442/838] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:15:54 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:15:54.717364 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c362d50e-2c50-448e-af37-ff6d20f39196 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:54.718029 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c362d50e-2c50-448e-af37-ff6d20f39196 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:54.724888 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c362d50e-2c50-448e-af37-ff6d20f39196 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:54.725413 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c362d50e-2c50-448e-af37-ff6d20f39196 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:54.726241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c362d50e-2c50-448e-af37-ff6d20f39196 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:54.726745 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c362d50e-2c50-448e-af37-ff6d20f39196 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:54.752431 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c362d50e-2c50-448e-af37-ff6d20f39196 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:15:54.786916 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:54.827668 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:54.828509 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c362d50e-2c50-448e-af37-ff6d20f39196 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 204 len: 0 microversion: 2.1 time: 0.115531 Jul 01 07:15:54.829773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 397/839] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:15:54 2022] DELETE /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:15:54.831260 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:54.838192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0ab112dc-d334-4373-b6a6-904261c8c474 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:54.838956 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0ab112dc-d334-4373-b6a6-904261c8c474 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:54.842277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:54.842731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:54.843729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:54.844690 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:54.846382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0ab112dc-d334-4373-b6a6-904261c8c474 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:54.846871 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0ab112dc-d334-4373-b6a6-904261c8c474 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:54.847660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0ab112dc-d334-4373-b6a6-904261c8c474 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:54.848101 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0ab112dc-d334-4373-b6a6-904261c8c474 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:55.045344 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:55.048317 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0ab112dc-d334-4373-b6a6-904261c8c474 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:55.053449 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:55.054970 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:55.055748 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0ab112dc-d334-4373-b6a6-904261c8c474 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1689 microversion: 2.1 time: 0.221887 Jul 01 07:15:55.056070 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8f70e424-dcef-4771-a5dc-13f3bca7af49 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.232377 Jul 01 07:15:55.056320 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 398/840] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:54 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:55.056615 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 443/841] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:54 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:56.073985 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:56.074763 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-55d6d1cd-b934-4e9f-a2f7-03366817e701 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:56.074763 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-55d6d1cd-b934-4e9f-a2f7-03366817e701 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:56.075243 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:56.081928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-55d6d1cd-b934-4e9f-a2f7-03366817e701 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:56.082374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-55d6d1cd-b934-4e9f-a2f7-03366817e701 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:56.082506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:56.082873 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:56.083159 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-55d6d1cd-b934-4e9f-a2f7-03366817e701 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:56.083597 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-55d6d1cd-b934-4e9f-a2f7-03366817e701 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:56.083713 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:56.084055 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:56.284035 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:56.287211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-55d6d1cd-b934-4e9f-a2f7-03366817e701 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:56.292257 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:56.293859 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:56.294705 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-55d6d1cd-b934-4e9f-a2f7-03366817e701 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1689 microversion: 2.1 time: 0.224856 Jul 01 07:15:56.295159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f263a71a-498c-4fb5-b0f3-4c844aac872e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.224935 Jul 01 07:15:56.295609 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 399/842] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:56 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:56.295833 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 444/843] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:56 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:15:57.223730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-673c2814-96c1-400b-a625-f6f8eaf2f301 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:15:57.224671 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-673c2814-96c1-400b-a625-f6f8eaf2f301 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:57.231060 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-673c2814-96c1-400b-a625-f6f8eaf2f301 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:57.231500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-673c2814-96c1-400b-a625-f6f8eaf2f301 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:57.232253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-673c2814-96c1-400b-a625-f6f8eaf2f301 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:57.232678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-673c2814-96c1-400b-a625-f6f8eaf2f301 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:57.303501 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-673c2814-96c1-400b-a625-f6f8eaf2f301 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "POST /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/action" status: 202 len: 0 microversion: 2.1 time: 0.084008 Jul 01 07:15:57.304247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 400/844] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:15:57 2022] POST /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:15:57.312426 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4d289fa1-d125-4089-80da-265fcee52959 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:57.312962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-320caff6-e345-4875-9348-bcf699243c8c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:57.313074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4d289fa1-d125-4089-80da-265fcee52959 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:57.313396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-320caff6-e345-4875-9348-bcf699243c8c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:57.319640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4d289fa1-d125-4089-80da-265fcee52959 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:57.319803 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-320caff6-e345-4875-9348-bcf699243c8c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:57.320087 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4d289fa1-d125-4089-80da-265fcee52959 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:57.320200 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-320caff6-e345-4875-9348-bcf699243c8c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:57.320853 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4d289fa1-d125-4089-80da-265fcee52959 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:57.320965 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-320caff6-e345-4875-9348-bcf699243c8c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:57.321286 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4d289fa1-d125-4089-80da-265fcee52959 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:57.321445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-320caff6-e345-4875-9348-bcf699243c8c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:57.521844 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4d289fa1-d125-4089-80da-265fcee52959 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:57.529370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4d289fa1-d125-4089-80da-265fcee52959 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1689 microversion: 2.1 time: 0.221016 Jul 01 07:15:57.529938 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 445/845] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:57 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:57.530738 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-320caff6-e345-4875-9348-bcf699243c8c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:57.535090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:57.535688 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:57.539725 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-320caff6-e345-4875-9348-bcf699243c8c tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1751 microversion: 2.1 time: 0.231226 Jul 01 07:15:57.540364 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 401/846] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:57 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:57.541640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:57.542097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:57.542885 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:57.543323 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:57.903519 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:57.911968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:57.913468 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:57.914565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f0b2b2bd-6d61-4bb8-89f3-4df15ad67e3c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.383723 Jul 01 07:15:57.915162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 446/847] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:57 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:58.546847 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d4c0a185-02d5-4904-aa07-fb41ef1fd61e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:58.547420 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d4c0a185-02d5-4904-aa07-fb41ef1fd61e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:58.550322 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:15:58.555815 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4c0a185-02d5-4904-aa07-fb41ef1fd61e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:58.556268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4c0a185-02d5-4904-aa07-fb41ef1fd61e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:58.557031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4c0a185-02d5-4904-aa07-fb41ef1fd61e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:58.557469 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d4c0a185-02d5-4904-aa07-fb41ef1fd61e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:58.559395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-de9e4f69-662a-4f7f-8b74-0199ccba7e29 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:58.560013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-de9e4f69-662a-4f7f-8b74-0199ccba7e29 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:58.567231 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-de9e4f69-662a-4f7f-8b74-0199ccba7e29 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:58.567681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-de9e4f69-662a-4f7f-8b74-0199ccba7e29 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:58.568440 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-de9e4f69-662a-4f7f-8b74-0199ccba7e29 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:58.568874 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-de9e4f69-662a-4f7f-8b74-0199ccba7e29 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:58.749777 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d4c0a185-02d5-4904-aa07-fb41ef1fd61e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:58.757263 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d4c0a185-02d5-4904-aa07-fb41ef1fd61e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1689 microversion: 2.1 time: 0.214298 Jul 01 07:15:58.757819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 402/848] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:58 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:58.764941 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-de9e4f69-662a-4f7f-8b74-0199ccba7e29 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:58.773443 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-de9e4f69-662a-4f7f-8b74-0199ccba7e29 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1751 microversion: 2.1 time: 0.218265 Jul 01 07:15:58.774013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 447/849] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:58 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:15:58.932281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:58.932897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:58.939323 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:58.939778 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:58.940544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:58.940983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:59.066280 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:59.074139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:59.075680 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:59.076783 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cc6fae3b-9de6-43bd-a4c2-2c9e7d67b77b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.148390 Jul 01 07:15:59.077348 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 403/850] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:15:58 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:15:59.774244 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d5b8903a-488d-4346-9755-c665ce216fad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:59.774882 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d5b8903a-488d-4346-9755-c665ce216fad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:59.781333 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5b8903a-488d-4346-9755-c665ce216fad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:59.781788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5b8903a-488d-4346-9755-c665ce216fad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:59.783089 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5b8903a-488d-4346-9755-c665ce216fad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:59.783527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5b8903a-488d-4346-9755-c665ce216fad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:59.790659 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a7325954-4ec2-4327-936e-f79666b0c415 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:15:59.791297 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a7325954-4ec2-4327-936e-f79666b0c415 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:15:59.797670 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a7325954-4ec2-4327-936e-f79666b0c415 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:59.798779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a7325954-4ec2-4327-936e-f79666b0c415 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:59.799562 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a7325954-4ec2-4327-936e-f79666b0c415 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:15:59.799997 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a7325954-4ec2-4327-936e-f79666b0c415 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:15:59.974121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d5b8903a-488d-4346-9755-c665ce216fad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:15:59.981552 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d5b8903a-488d-4346-9755-c665ce216fad tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1689 microversion: 2.1 time: 0.211164 Jul 01 07:15:59.982309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 448/851] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:59 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:15:59.997791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a7325954-4ec2-4327-936e-f79666b0c415 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:00.005603 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a7325954-4ec2-4327-936e-f79666b0c415 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1751 microversion: 2.1 time: 0.218716 Jul 01 07:16:00.006168 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 404/852] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:15:59 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:16:00.095171 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:00.095738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:00.101820 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:00.102268 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:00.103094 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:00.103533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:00.229227 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:00.237125 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:00.238622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:00.239751 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a4109017-f73b-4a3b-b369-a5d8942a0484 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.149141 Jul 01 07:16:00.240309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 449/853] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:16:00 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:16:00.998563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-29fdd31c-19d0-4cb6-8b70-c92acb453ed6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:00.999825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-29fdd31c-19d0-4cb6-8b70-c92acb453ed6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:01.006555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-29fdd31c-19d0-4cb6-8b70-c92acb453ed6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:01.007070 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-29fdd31c-19d0-4cb6-8b70-c92acb453ed6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:01.007893 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-29fdd31c-19d0-4cb6-8b70-c92acb453ed6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:01.008326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-29fdd31c-19d0-4cb6-8b70-c92acb453ed6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:01.022991 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9ed85668-f068-48c7-9443-21665f106cfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:01.024393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9ed85668-f068-48c7-9443-21665f106cfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:01.031638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9ed85668-f068-48c7-9443-21665f106cfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:01.032123 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9ed85668-f068-48c7-9443-21665f106cfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:01.032909 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9ed85668-f068-48c7-9443-21665f106cfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:01.033345 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9ed85668-f068-48c7-9443-21665f106cfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:01.263396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:01.282930 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=6 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:01.406758 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=6 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:01.452197 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-29fdd31c-19d0-4cb6-8b70-c92acb453ed6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:01.461684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-29fdd31c-19d0-4cb6-8b70-c92acb453ed6 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1689 microversion: 2.1 time: 0.466869 Jul 01 07:16:01.462499 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 405/854] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:00 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1689 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:01.467255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:01.467858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:01.476480 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:01.477005 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:01.478409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:01.478965 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:01.479283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9ed85668-f068-48c7-9443-21665f106cfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:01.488834 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9ed85668-f068-48c7-9443-21665f106cfe tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1751 microversion: 2.1 time: 0.469604 Jul 01 07:16:01.489678 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 450/855] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:01 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1751 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:16:01.760693 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:01.769688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:01.771155 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:01.772265 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c548e270-ff10-4930-8648-f5296cf48385 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.308624 Jul 01 07:16:01.772817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 406/856] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:16:01 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:16:02.164378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-55d3e836-15c5-492c-ad1a-e1bb029be37d req-f5520753-25a0-47af-9fdb-1d53c0d76a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0721e7-9239-4832-b6dc-329e0682e8c6", "name": "network-vif-deleted", "tag": "55005d37-c17f-4cd9-ba0e-3e7034d6e963"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:16:02.173977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-55d3e836-15c5-492c-ad1a-e1bb029be37d req-f5520753-25a0-47af-9fdb-1d53c0d76a6a service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:02.174485 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-55d3e836-15c5-492c-ad1a-e1bb029be37d req-f5520753-25a0-47af-9fdb-1d53c0d76a6a service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:02.187467 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-55d3e836-15c5-492c-ad1a-e1bb029be37d req-f5520753-25a0-47af-9fdb-1d53c0d76a6a service nova] Creating event network-vif-deleted:55005d37-c17f-4cd9-ba0e-3e7034d6e963 for instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 on hv-cinder-80721 Jul 01 07:16:02.196951 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-55d3e836-15c5-492c-ad1a-e1bb029be37d req-f5520753-25a0-47af-9fdb-1d53c0d76a6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035821 Jul 01 07:16:02.197571 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 451/857] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:16:02.480232 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:02.480812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:02.486952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:02.487575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:02.488406 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:02.488848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:02.507126 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3d265c44-7e54-4cff-9fdb-9ab121010bfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:02.507936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3d265c44-7e54-4cff-9fdb-9ab121010bfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:02.514915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3d265c44-7e54-4cff-9fdb-9ab121010bfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:02.515371 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3d265c44-7e54-4cff-9fdb-9ab121010bfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:02.516151 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3d265c44-7e54-4cff-9fdb-9ab121010bfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:02.517169 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3d265c44-7e54-4cff-9fdb-9ab121010bfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:02.523658 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:02.524159 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:02.524886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lazy-loading 'fault' on Instance uuid 0c0721e7-9239-4832-b6dc-329e0682e8c6 {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:16:02.568167 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:02.578254 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b8584833-f2b7-4a7e-a0e3-36fcba625f10 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 200 len: 1334 microversion: 2.1 time: 0.102003 Jul 01 07:16:02.578893 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 407/858] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:02 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:02.678530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3d265c44-7e54-4cff-9fdb-9ab121010bfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:02.686839 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3d265c44-7e54-4cff-9fdb-9ab121010bfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.184676 Jul 01 07:16:02.687414 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 452/859] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:02 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:16:02.789625 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:02.790312 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:02.796768 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:02.797289 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:02.798194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:02.798625 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:03.097149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:03.105174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:03.106665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:03.107782 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b4867ace-0083-4909-8ecd-a7914e86300a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.322273 Jul 01 07:16:03.108328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 408/860] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:16:02 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:16:03.473894 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-abc5e60e-b995-4f40-a0e2-a3ae61ec213d req-4822d694-4311-4757-a640-c9f866b7c787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cecf2b-81c9-42be-9f7c-a2b9c74f1d76", "name": "network-vif-plugged", "status": "completed", "tag": "124d2096-5c39-4eaf-8073-f7d321f44142"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:16:03.482730 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-abc5e60e-b995-4f40-a0e2-a3ae61ec213d req-4822d694-4311-4757-a640-c9f866b7c787 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:03.483241 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-abc5e60e-b995-4f40-a0e2-a3ae61ec213d req-4822d694-4311-4757-a640-c9f866b7c787 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:03.495750 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-abc5e60e-b995-4f40-a0e2-a3ae61ec213d req-4822d694-4311-4757-a640-c9f866b7c787 service nova] Creating event network-vif-plugged:124d2096-5c39-4eaf-8073-f7d321f44142 for instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 on hv-cinder-80721 Jul 01 07:16:03.500644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-abc5e60e-b995-4f40-a0e2-a3ae61ec213d req-4822d694-4311-4757-a640-c9f866b7c787 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030947 Jul 01 07:16:03.501419 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 453/861] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:16:03.596278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:03.596886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 0c0721e7-9239-4832-b6dc-329e0682e8c6] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:03.603688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:03.604142 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:03.604908 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:03.605345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:03.620265 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] HTTP exception thrown: Instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 could not be found. Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Request method failure captured: Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 HTTP/1.1 Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1vWP5A9U2vwZcgA-tmIL0Abtmkf8fLJBmpYavmK6tX87ap-wh-MMPjAN54eWsMEvlA9CNKK8ZNJvBN_sDBho2dlNvmRqfRkrjl7kZ9B5Xu8-dyRRMNjooE7_SwyP6EeN2-wfuby7sk0XY1GHr44Xqj8fuKtr5klSaTUVH2ziarw-8 Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:16:03.621842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d94c1c234804421487c49cc9df6ff888"}]}] Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 4549c33736bc413a87460db0c43f5768 Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 could not be found. Jul 01 07:16:03.623742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '0c0721e7-9239-4832-b6dc-329e0682e8c6'} Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 could not be found. Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:16:03.624583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 could not be found. Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 could not be found. Jul 01 07:16:03.625859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:03.627028 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Returning 404 to user: Instance 0c0721e7-9239-4832-b6dc-329e0682e8c6 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:16:03.627028 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5a2dd2c3-50cf-4884-8b13-451871dff2c9 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6" status: 404 len: 111 microversion: 2.1 time: 0.031509 Jul 01 07:16:03.627028 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 409/862] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:03 2022] GET /compute/v2.1/servers/0c0721e7-9239-4832-b6dc-329e0682e8c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:16:03.632818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ac58604f-5e2a-48e5-8710-370c235ce309 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '.version_select at 0x7f2c4a36d790>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:03.650341 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ac58604f-5e2a-48e5-8710-370c235ce309 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988787965" status: 202 len: 0 microversion: 2.1 time: 0.021696 Jul 01 07:16:03.650945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 454/863] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jul 1 07:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988787965 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:16:03.705385 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c4de7575-29bc-494d-b595-adb97b7e1ad0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:03.706003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c4de7575-29bc-494d-b595-adb97b7e1ad0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:03.712174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c4de7575-29bc-494d-b595-adb97b7e1ad0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:03.712710 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c4de7575-29bc-494d-b595-adb97b7e1ad0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:03.713551 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c4de7575-29bc-494d-b595-adb97b7e1ad0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:03.714137 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c4de7575-29bc-494d-b595-adb97b7e1ad0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:03.900689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c4de7575-29bc-494d-b595-adb97b7e1ad0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:03.909314 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c4de7575-29bc-494d-b595-adb97b7e1ad0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.208489 Jul 01 07:16:03.909859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 410/864] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:03 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:04.126202 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:04.127064 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:04.133192 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:04.133640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:04.134402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:04.134855 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:04.149952 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:04.274909 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:04.282964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:04.284711 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:04.285880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d9a19c44-5470-4da1-ac88-79d497514619 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.164248 Jul 01 07:16:04.286518 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 455/865] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:16:04 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:16:04.926678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f4c033dc-e70c-4a0d-8543-c9a870e4d409 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:04.927321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f4c033dc-e70c-4a0d-8543-c9a870e4d409 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:04.933771 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f4c033dc-e70c-4a0d-8543-c9a870e4d409 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:04.934489 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f4c033dc-e70c-4a0d-8543-c9a870e4d409 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:04.935283 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f4c033dc-e70c-4a0d-8543-c9a870e4d409 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:04.935722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f4c033dc-e70c-4a0d-8543-c9a870e4d409 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:05.076225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f4c033dc-e70c-4a0d-8543-c9a870e4d409 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:05.083470 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f4c033dc-e70c-4a0d-8543-c9a870e4d409 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.161208 Jul 01 07:16:05.084026 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 411/866] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:04 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:05.303973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:05.304517 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:05.311408 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:05.311856 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:05.312617 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:05.313052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:05.445511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:05.456146 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:05.457654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:05.458784 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7ddb1776-51aa-4c4d-b547-87d9eb1fbb0a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1407 microversion: 2.20 time: 0.158774 Jul 01 07:16:05.459613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 456/867] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:16:05 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:16:06.101021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-feffc304-1954-44bc-9c29-2b583cd57c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:06.101586 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-feffc304-1954-44bc-9c29-2b583cd57c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:06.108193 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-feffc304-1954-44bc-9c29-2b583cd57c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.108653 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-feffc304-1954-44bc-9c29-2b583cd57c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.109428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-feffc304-1954-44bc-9c29-2b583cd57c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.110006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-feffc304-1954-44bc-9c29-2b583cd57c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.253779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-feffc304-1954-44bc-9c29-2b583cd57c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:06.261732 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-feffc304-1954-44bc-9c29-2b583cd57c20 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.164680 Jul 01 07:16:06.262291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 412/868] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:06 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:06.476722 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:06.477326 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:06.483776 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.484220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.485120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.485564 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.518445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d49e8275-3c46-4c70-8b43-61ab79fc3c9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:06.518987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d49e8275-3c46-4c70-8b43-61ab79fc3c9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:06.525097 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d49e8275-3c46-4c70-8b43-61ab79fc3c9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.525550 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d49e8275-3c46-4c70-8b43-61ab79fc3c9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.526328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d49e8275-3c46-4c70-8b43-61ab79fc3c9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.526782 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d49e8275-3c46-4c70-8b43-61ab79fc3c9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.530800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:06.553222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d49e8275-3c46-4c70-8b43-61ab79fc3c9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:16:06.616609 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:06.627406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:06.629394 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d49e8275-3c46-4c70-8b43-61ab79fc3c9d tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "DELETE /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 204 len: 0 microversion: 2.1 time: 0.115400 Jul 01 07:16:06.629779 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:06.630065 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 413/869] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:16:06 2022] DELETE /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:16:06.631068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-aa27305b-3c1b-46e0-8bdb-6602d0a1d745 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1599 microversion: 2.20 time: 0.158232 Jul 01 07:16:06.643622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 457/870] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:16:06 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:16:06.644105 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-91d0ff83-e5b9-4986-807e-e71a093866fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:06.644832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-91d0ff83-e5b9-4986-807e-e71a093866fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:06.648798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-562e43a7-0449-424b-b724-8518291f6718 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:06.649309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-562e43a7-0449-424b-b724-8518291f6718 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:06.650924 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-91d0ff83-e5b9-4986-807e-e71a093866fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.651416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-91d0ff83-e5b9-4986-807e-e71a093866fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.652189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-91d0ff83-e5b9-4986-807e-e71a093866fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.652629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-91d0ff83-e5b9-4986-807e-e71a093866fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.655095 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-562e43a7-0449-424b-b724-8518291f6718 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.655539 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-562e43a7-0449-424b-b724-8518291f6718 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.656294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-562e43a7-0449-424b-b724-8518291f6718 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:06.656724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-562e43a7-0449-424b-b724-8518291f6718 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:06.765120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-562e43a7-0449-424b-b724-8518291f6718 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.120264 Jul 01 07:16:06.765787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 458/871] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jul 1 07:16:06 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:16:07.141442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-91d0ff83-e5b9-4986-807e-e71a093866fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:07.148904 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-91d0ff83-e5b9-4986-807e-e71a093866fe tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1508 microversion: 2.1 time: 0.509042 Jul 01 07:16:07.149463 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 414/872] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:06 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1508 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:16:07.279555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c0452212-3509-48d5-b9de-a383b0d3f134 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:07.280348 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c0452212-3509-48d5-b9de-a383b0d3f134 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:07.286946 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0452212-3509-48d5-b9de-a383b0d3f134 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:07.287409 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0452212-3509-48d5-b9de-a383b0d3f134 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:07.288187 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0452212-3509-48d5-b9de-a383b0d3f134 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:07.288630 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c0452212-3509-48d5-b9de-a383b0d3f134 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:07.563592 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c0452212-3509-48d5-b9de-a383b0d3f134 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:07.571411 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c0452212-3509-48d5-b9de-a383b0d3f134 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.295805 Jul 01 07:16:07.571973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 459/873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:07 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:16:08.166633 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a0406427-de76-4415-b21e-b2ba92cd9229 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:08.167319 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a0406427-de76-4415-b21e-b2ba92cd9229 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:08.174344 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a0406427-de76-4415-b21e-b2ba92cd9229 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:08.174805 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a0406427-de76-4415-b21e-b2ba92cd9229 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:08.175569 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a0406427-de76-4415-b21e-b2ba92cd9229 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:08.175998 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a0406427-de76-4415-b21e-b2ba92cd9229 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:08.310436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-1e8d05a1-5166-4c20-9c96-8651bba53dd7 req-246e305f-c555-4067-b9b7-ff496b9938e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cecf2b-81c9-42be-9f7c-a2b9c74f1d76", "tag": "124d2096-5c39-4eaf-8073-f7d321f44142"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:16:08.319523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-1e8d05a1-5166-4c20-9c96-8651bba53dd7 req-246e305f-c555-4067-b9b7-ff496b9938e2 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:08.320083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-1e8d05a1-5166-4c20-9c96-8651bba53dd7 req-246e305f-c555-4067-b9b7-ff496b9938e2 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:08.331720 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-1e8d05a1-5166-4c20-9c96-8651bba53dd7 req-246e305f-c555-4067-b9b7-ff496b9938e2 service nova] Creating event network-changed:124d2096-5c39-4eaf-8073-f7d321f44142 for instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 on hv-cinder-80721 Jul 01 07:16:08.338050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-1e8d05a1-5166-4c20-9c96-8651bba53dd7 req-246e305f-c555-4067-b9b7-ff496b9938e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031245 Jul 01 07:16:08.338948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 460/874] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:16:08.424856 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a0406427-de76-4415-b21e-b2ba92cd9229 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:08.432711 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a0406427-de76-4415-b21e-b2ba92cd9229 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 200 len: 1508 microversion: 2.1 time: 0.269919 Jul 01 07:16:08.433593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 415/875] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:08 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:08.592381 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-49353637-31ab-49e9-ab76-8b30555ca202 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:08.593898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-49353637-31ab-49e9-ab76-8b30555ca202 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:08.604035 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-49353637-31ab-49e9-ab76-8b30555ca202 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:08.605324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-49353637-31ab-49e9-ab76-8b30555ca202 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:08.606195 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-49353637-31ab-49e9-ab76-8b30555ca202 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:08.606814 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-49353637-31ab-49e9-ab76-8b30555ca202 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:08.854193 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-49353637-31ab-49e9-ab76-8b30555ca202 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:08.863503 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-49353637-31ab-49e9-ab76-8b30555ca202 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.277460 Jul 01 07:16:08.864412 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 461/876] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:08 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:09.450660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:09.451329 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 15849f34-94b8-4797-b899-2c1e6ea4fb3d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:09.458675 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:09.459168 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:09.459940 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:09.460378 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:09.473693 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] HTTP exception thrown: Instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d could not be found. Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Request method failure captured: Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d HTTP/1.1 Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1vWP5A9U2vwZcgA-tmIL0Abtmkf8fLJBmpYavmK6tX87ap-wh-MMPjAN54eWsMEvlA9CNKK8ZNJvBN_sDBho2dlNvmRqfRkrjl7kZ9B5Xu8-dyRRMNjooE7_SwyP6EeN2-wfuby7sk0XY1GHr44Xqj8fuKtr5klSaTUVH2ziarw-8 Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:16:09.475381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d94c1c234804421487c49cc9df6ff888"}]}] Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 4549c33736bc413a87460db0c43f5768 Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d could not be found. Jul 01 07:16:09.477103 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '15849f34-94b8-4797-b899-2c1e6ea4fb3d'} Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d could not be found. Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:16:09.478313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d could not be found. Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d could not be found. Jul 01 07:16:09.479773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:09.481098 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Returning 404 to user: Instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:16:09.481098 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6c98fd05-daac-47b0-92fe-d61e0dc2cfb0 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d" status: 404 len: 111 microversion: 2.1 time: 0.029987 Jul 01 07:16:09.481098 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 416/877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:09 2022] GET /compute/v2.1/servers/15849f34-94b8-4797-b899-2c1e6ea4fb3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:16:09.485334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8bf0ffd7-8a0a-46be-a6ad-7600c1fb234e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:09.485829 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8bf0ffd7-8a0a-46be-a6ad-7600c1fb234e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:09.493489 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8bf0ffd7-8a0a-46be-a6ad-7600c1fb234e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:09.495429 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8bf0ffd7-8a0a-46be-a6ad-7600c1fb234e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:09.496218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8bf0ffd7-8a0a-46be-a6ad-7600c1fb234e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:09.496656 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8bf0ffd7-8a0a-46be-a6ad-7600c1fb234e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:09.524580 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8bf0ffd7-8a0a-46be-a6ad-7600c1fb234e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:16:09.597024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8bf0ffd7-8a0a-46be-a6ad-7600c1fb234e tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 204 len: 0 microversion: 2.1 time: 0.115216 Jul 01 07:16:09.597895 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 462/878] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:16:09 2022] DELETE /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:16:09.606025 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-81f0d4b3-f7eb-4eaf-ac6f-1e1f95b47e4f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:09.606639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-81f0d4b3-f7eb-4eaf-ac6f-1e1f95b47e4f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:09.613177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-81f0d4b3-f7eb-4eaf-ac6f-1e1f95b47e4f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:09.613629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-81f0d4b3-f7eb-4eaf-ac6f-1e1f95b47e4f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:09.614393 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-81f0d4b3-f7eb-4eaf-ac6f-1e1f95b47e4f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:09.614851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-81f0d4b3-f7eb-4eaf-ac6f-1e1f95b47e4f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:09.742614 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-81f0d4b3-f7eb-4eaf-ac6f-1e1f95b47e4f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:09.749988 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-81f0d4b3-f7eb-4eaf-ac6f-1e1f95b47e4f tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.147938 Jul 01 07:16:09.751166 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 417/879] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:09 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:09.881852 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-cef8bf8e-0797-49f1-983e-9de748a9c2ee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:09.882549 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-cef8bf8e-0797-49f1-983e-9de748a9c2ee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:09.888948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cef8bf8e-0797-49f1-983e-9de748a9c2ee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:09.889394 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cef8bf8e-0797-49f1-983e-9de748a9c2ee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:09.890147 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cef8bf8e-0797-49f1-983e-9de748a9c2ee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:09.890579 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-cef8bf8e-0797-49f1-983e-9de748a9c2ee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:10.030549 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-cef8bf8e-0797-49f1-983e-9de748a9c2ee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:10.038873 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-cef8bf8e-0797-49f1-983e-9de748a9c2ee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.161150 Jul 01 07:16:10.039428 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 463/880] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:09 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:10.373782 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-03b15a09-7a41-47a0-bce6-7e90c17551b6 req-8a5ac307-9145-49d5-8528-30959cf7e07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15849f34-94b8-4797-b899-2c1e6ea4fb3d", "name": "network-vif-deleted", "tag": "8bfa5bd3-77e4-4c39-a2bf-c0c691f11452"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:16:10.381788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-03b15a09-7a41-47a0-bce6-7e90c17551b6 req-8a5ac307-9145-49d5-8528-30959cf7e07f service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:10.382230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-03b15a09-7a41-47a0-bce6-7e90c17551b6 req-8a5ac307-9145-49d5-8528-30959cf7e07f service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:10.393324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-03b15a09-7a41-47a0-bce6-7e90c17551b6 req-8a5ac307-9145-49d5-8528-30959cf7e07f service nova] Creating event network-vif-deleted:8bfa5bd3-77e4-4c39-a2bf-c0c691f11452 for instance 15849f34-94b8-4797-b899-2c1e6ea4fb3d on hv-cinder-80721 Jul 01 07:16:10.398067 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-03b15a09-7a41-47a0-bce6-7e90c17551b6 req-8a5ac307-9145-49d5-8528-30959cf7e07f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027976 Jul 01 07:16:10.398628 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 418/881] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:16:10.768848 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8a4c00c0-07dc-465f-be53-e88842051395 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:10.769473 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8a4c00c0-07dc-465f-be53-e88842051395 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:10.775736 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a4c00c0-07dc-465f-be53-e88842051395 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:10.776181 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a4c00c0-07dc-465f-be53-e88842051395 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:10.776942 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a4c00c0-07dc-465f-be53-e88842051395 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:10.777378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a4c00c0-07dc-465f-be53-e88842051395 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:10.979644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8a4c00c0-07dc-465f-be53-e88842051395 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4549c33736bc413a87460db0c43f5768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c1c234804421487c49cc9df6ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:10.990255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8a4c00c0-07dc-465f-be53-e88842051395 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 200 len: 1522 microversion: 2.1 time: 0.225806 Jul 01 07:16:10.991404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 464/882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:10 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:16:11.057660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7eb8b5c0-5722-4db7-8f7d-02b6fad45f8b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:11.058365 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7eb8b5c0-5722-4db7-8f7d-02b6fad45f8b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:11.065379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5c0-5722-4db7-8f7d-02b6fad45f8b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:11.065834 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5c0-5722-4db7-8f7d-02b6fad45f8b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:11.066598 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5c0-5722-4db7-8f7d-02b6fad45f8b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:11.067062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5c0-5722-4db7-8f7d-02b6fad45f8b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:11.224418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7eb8b5c0-5722-4db7-8f7d-02b6fad45f8b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:11.232385 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7eb8b5c0-5722-4db7-8f7d-02b6fad45f8b tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.179633 Jul 01 07:16:11.232937 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 419/883] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:11 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:12.008109 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:12.008825 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] [instance: 3445a4a9-908c-4f8d-a9f0-192f84c2158a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:12.015406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:12.015861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:12.017152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:12.017575 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:12.030890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] HTTP exception thrown: Instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a could not be found. Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Request method failure captured: Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a HTTP/1.1 Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1vWP5A9U2vwZcgA-tmIL0Abtmkf8fLJBmpYavmK6tX87ap-wh-MMPjAN54eWsMEvlA9CNKK8ZNJvBN_sDBho2dlNvmRqfRkrjl7kZ9B5Xu8-dyRRMNjooE7_SwyP6EeN2-wfuby7sk0XY1GHr44Xqj8fuKtr5klSaTUVH2ziarw-8 Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:16:12.033154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d94c1c234804421487c49cc9df6ff888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d94c1c234804421487c49cc9df6ff888"}]}] Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: d94c1c234804421487c49cc9df6ff888 Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-458941710 Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 4549c33736bc413a87460db0c43f5768 Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-458941710-project Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a could not be found. Jul 01 07:16:12.034735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '3445a4a9-908c-4f8d-a9f0-192f84c2158a'} Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a could not be found. Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:16:12.035659 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a could not be found. Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a could not be found. Jul 01 07:16:12.037116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:16:12.038378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] Returning 404 to user: Instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:16:12.038378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4d743d9b-4af3-4dec-9678-f2bca0ef5014 tempest-ServerRescueNegativeTestJSON-458941710 tempest-ServerRescueNegativeTestJSON-458941710-project] 10.222.0.48 "GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a" status: 404 len: 111 microversion: 2.1 time: 0.030576 Jul 01 07:16:12.038378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 465/884] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:12 2022] GET /compute/v2.1/servers/3445a4a9-908c-4f8d-a9f0-192f84c2158a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:16:12.249637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-86c2f67f-d3e1-42f4-a771-a523c4add763 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:12.250333 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-86c2f67f-d3e1-42f4-a771-a523c4add763 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:12.257518 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-86c2f67f-d3e1-42f4-a771-a523c4add763 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:12.257961 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-86c2f67f-d3e1-42f4-a771-a523c4add763 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:12.258783 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-86c2f67f-d3e1-42f4-a771-a523c4add763 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:12.259178 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-86c2f67f-d3e1-42f4-a771-a523c4add763 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:12.544586 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-69daebc0-a0a1-4145-85eb-a0de0c458f70 req-a6b31de0-b413-4500-bff6-9c2a3f536200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3445a4a9-908c-4f8d-a9f0-192f84c2158a", "name": "network-vif-deleted", "tag": "4376d892-b82b-4683-8603-3bf6bc709973"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:16:12.552679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-69daebc0-a0a1-4145-85eb-a0de0c458f70 req-a6b31de0-b413-4500-bff6-9c2a3f536200 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:12.553119 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-69daebc0-a0a1-4145-85eb-a0de0c458f70 req-a6b31de0-b413-4500-bff6-9c2a3f536200 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:12.564614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-69daebc0-a0a1-4145-85eb-a0de0c458f70 req-a6b31de0-b413-4500-bff6-9c2a3f536200 service nova] Creating event network-vif-deleted:4376d892-b82b-4683-8603-3bf6bc709973 for instance 3445a4a9-908c-4f8d-a9f0-192f84c2158a on hv-cinder-80721 Jul 01 07:16:12.569348 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-69daebc0-a0a1-4145-85eb-a0de0c458f70 req-a6b31de0-b413-4500-bff6-9c2a3f536200 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028568 Jul 01 07:16:12.569932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 466/885] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:16:12.700940 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-86c2f67f-d3e1-42f4-a771-a523c4add763 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:12.709155 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-86c2f67f-d3e1-42f4-a771-a523c4add763 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.463420 Jul 01 07:16:12.709712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 420/886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:12 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:13.727424 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-93200590-07fb-4393-a3dd-68f79d65661e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:13.728124 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-93200590-07fb-4393-a3dd-68f79d65661e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:13.734439 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-93200590-07fb-4393-a3dd-68f79d65661e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:13.734923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-93200590-07fb-4393-a3dd-68f79d65661e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:13.735706 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-93200590-07fb-4393-a3dd-68f79d65661e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:13.736138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-93200590-07fb-4393-a3dd-68f79d65661e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:13.889211 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-93200590-07fb-4393-a3dd-68f79d65661e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:13.897778 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-93200590-07fb-4393-a3dd-68f79d65661e tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.175061 Jul 01 07:16:13.898543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 467/887] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:13 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:14.914737 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5fe3463a-ba12-4053-8620-d72a002c2fee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:14.916233 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5fe3463a-ba12-4053-8620-d72a002c2fee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:14.922519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5fe3463a-ba12-4053-8620-d72a002c2fee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:14.923002 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5fe3463a-ba12-4053-8620-d72a002c2fee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:14.923792 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5fe3463a-ba12-4053-8620-d72a002c2fee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:14.924217 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5fe3463a-ba12-4053-8620-d72a002c2fee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:15.152349 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5fe3463a-ba12-4053-8620-d72a002c2fee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:15.162405 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5fe3463a-ba12-4053-8620-d72a002c2fee tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.251463 Jul 01 07:16:15.163235 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 421/888] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:14 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:16.179936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a2e4bfeb-b7f8-4353-b104-eba7b879e778 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:16.180635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a2e4bfeb-b7f8-4353-b104-eba7b879e778 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:16.187506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a2e4bfeb-b7f8-4353-b104-eba7b879e778 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:16.188019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a2e4bfeb-b7f8-4353-b104-eba7b879e778 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:16.190807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a2e4bfeb-b7f8-4353-b104-eba7b879e778 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:16.190807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a2e4bfeb-b7f8-4353-b104-eba7b879e778 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:16.331719 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a2e4bfeb-b7f8-4353-b104-eba7b879e778 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:16.340637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a2e4bfeb-b7f8-4353-b104-eba7b879e778 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.164656 Jul 01 07:16:16.341206 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 468/889] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:16 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:17.361104 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-dc7ca53f-b63f-4210-8fd5-f555963f9ca5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:17.361939 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-dc7ca53f-b63f-4210-8fd5-f555963f9ca5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:17.369125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc7ca53f-b63f-4210-8fd5-f555963f9ca5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:17.369580 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc7ca53f-b63f-4210-8fd5-f555963f9ca5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:17.370458 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc7ca53f-b63f-4210-8fd5-f555963f9ca5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:17.370881 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-dc7ca53f-b63f-4210-8fd5-f555963f9ca5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:17.521870 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-dc7ca53f-b63f-4210-8fd5-f555963f9ca5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:17.530214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-dc7ca53f-b63f-4210-8fd5-f555963f9ca5 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1756 microversion: 2.1 time: 0.174423 Jul 01 07:16:17.531165 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 422/890] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:17 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:18.549078 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-864fc266-e111-4c42-b12c-3c82789a37da tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:18.549907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-864fc266-e111-4c42-b12c-3c82789a37da tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:18.552740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:18.557972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-864fc266-e111-4c42-b12c-3c82789a37da tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:18.558623 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-864fc266-e111-4c42-b12c-3c82789a37da tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:18.559705 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-864fc266-e111-4c42-b12c-3c82789a37da tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:18.560318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-864fc266-e111-4c42-b12c-3c82789a37da tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:18.711331 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-864fc266-e111-4c42-b12c-3c82789a37da tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:18.720050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-864fc266-e111-4c42-b12c-3c82789a37da tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1759 microversion: 2.1 time: 0.175233 Jul 01 07:16:18.720796 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 469/891] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:18 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:46.087780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fe4c3aaa-b173-42ca-b81f-c6d924cbe1db tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:46.088394 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fe4c3aaa-b173-42ca-b81f-c6d924cbe1db tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:46.090558 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:46.091225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:46.097732 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe4c3aaa-b173-42ca-b81f-c6d924cbe1db tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:46.098189 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe4c3aaa-b173-42ca-b81f-c6d924cbe1db tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:46.099008 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe4c3aaa-b173-42ca-b81f-c6d924cbe1db tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:46.099432 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe4c3aaa-b173-42ca-b81f-c6d924cbe1db tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:46.125310 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fe4c3aaa-b173-42ca-b81f-c6d924cbe1db tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/ips" status: 200 len: 151 microversion: 2.1 time: 0.041716 Jul 01 07:16:46.125857 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 423/892] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:16:46 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:16:47.432597 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9a895d14-1e87-45be-b424-445b576d8b2a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f28cc1c4-7e02-4203-9548-71ea69ed6d84"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:16:47.433654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9a895d14-1e87-45be-b424-445b576d8b2a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:47.436012 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:47.436762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:16:47.442257 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9a895d14-1e87-45be-b424-445b576d8b2a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:47.442703 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9a895d14-1e87-45be-b424-445b576d8b2a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:47.443483 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9a895d14-1e87-45be-b424-445b576d8b2a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:47.443919 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9a895d14-1e87-45be-b424-445b576d8b2a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:47.720793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9a895d14-1e87-45be-b424-445b576d8b2a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292059 Jul 01 07:16:47.722088 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 470/893] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:16:47 2022] POST /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:16:55.199911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f28cc1c4-7e02-4203-9548-71ea69ed6d84"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:16:55.201017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:55.207997 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:55.208448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:55.209222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:55.209655 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:55.288412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Invalid volume: volume f28cc1c4-7e02-4203-9548-71ea69ed6d84 is already attached to instances: 55170f1a-b683-46b7-955c-60a9344796e2 Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: POST /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments HTTP/1.1 Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 74 Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:16:55.290421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {"volumeAttachment": {"volumeId": "f28cc1c4-7e02-4203-9548-71ea69ed6d84"}} Jul 01 07:16:55.292078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Invalid volume: volume f28cc1c4-7e02-4203-9548-71ea69ed6d84 is already attached to instances: 55170f1a-b683-46b7-955c-60a9344796e2 Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'server_id': '55170f1a-b683-46b7-955c-60a9344796e2', 'body': {'volumeAttachment': {'volumeId': 'f28cc1c4-7e02-4203-9548-71ea69ed6d84'}}} Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f28cc1c4-7e02-4203-9548-71ea69ed6d84 is already attached to instances: 55170f1a-b683-46b7-955c-60a9344796e2 Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:55.293024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f28cc1c4-7e02-4203-9548-71ea69ed6d84 is already attached to instances: 55170f1a-b683-46b7-955c-60a9344796e2 Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:16:55.294465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:16:55.296253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:16:55.296253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:16:55.296253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:16:55.296253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f28cc1c4-7e02-4203-9548-71ea69ed6d84 is already attached to instances: 55170f1a-b683-46b7-955c-60a9344796e2 Jul 01 07:16:55.296253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:16:55.296253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 400 to user: Invalid volume: volume f28cc1c4-7e02-4203-9548-71ea69ed6d84 is already attached to instances: 55170f1a-b683-46b7-955c-60a9344796e2 {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:16:55.296253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ffbcda3d-c489-4ca6-bb74-7acc7d0c885a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095934 Jul 01 07:16:55.296253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 424/894] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:16:55 2022] POST /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:16:55.353742 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e12db606-adf0-46e1-ad5c-928d9a27669f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:55.354324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e12db606-adf0-46e1-ad5c-928d9a27669f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:55.360464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e12db606-adf0-46e1-ad5c-928d9a27669f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:55.360910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e12db606-adf0-46e1-ad5c-928d9a27669f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:55.362182 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e12db606-adf0-46e1-ad5c-928d9a27669f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:55.362617 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e12db606-adf0-46e1-ad5c-928d9a27669f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:55.443440 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-e12db606-adf0-46e1-ad5c-928d9a27669f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lazy-loading 'services' on Instance uuid 55170f1a-b683-46b7-955c-60a9344796e2 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:16:55.512537 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e12db606-adf0-46e1-ad5c-928d9a27669f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments/f28cc1c4-7e02-4203-9548-71ea69ed6d84" status: 202 len: 0 microversion: 2.1 time: 0.163316 Jul 01 07:16:55.513108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 471/895] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:16:55 2022] DELETE /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments/f28cc1c4-7e02-4203-9548-71ea69ed6d84 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:16:55.521781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-db822b60-5920-4f46-832d-c99a3adaaef0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:55.524137 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-db822b60-5920-4f46-832d-c99a3adaaef0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:55.532428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-db822b60-5920-4f46-832d-c99a3adaaef0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:55.534586 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-db822b60-5920-4f46-832d-c99a3adaaef0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:55.534586 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-db822b60-5920-4f46-832d-c99a3adaaef0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:55.535157 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-db822b60-5920-4f46-832d-c99a3adaaef0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:55.567239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-db822b60-5920-4f46-832d-c99a3adaaef0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049262 Jul 01 07:16:55.571072 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 425/896] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:16:55 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:16:56.579968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-44e3d5bd-3e22-43e4-907a-074239ddb824 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:56.581604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-44e3d5bd-3e22-43e4-907a-074239ddb824 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:56.587768 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-44e3d5bd-3e22-43e4-907a-074239ddb824 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:56.588221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-44e3d5bd-3e22-43e4-907a-074239ddb824 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:56.588980 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-44e3d5bd-3e22-43e4-907a-074239ddb824 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:56.589409 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-44e3d5bd-3e22-43e4-907a-074239ddb824 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:56.618308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-44e3d5bd-3e22-43e4-907a-074239ddb824 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043283 Jul 01 07:16:56.618872 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 472/897] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:16:56 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:16:57.631207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ff0edf03-261d-4b13-9f3f-91f41c266485 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:57.632117 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ff0edf03-261d-4b13-9f3f-91f41c266485 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:57.638622 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ff0edf03-261d-4b13-9f3f-91f41c266485 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:57.639100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ff0edf03-261d-4b13-9f3f-91f41c266485 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:57.639851 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ff0edf03-261d-4b13-9f3f-91f41c266485 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:57.640278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ff0edf03-261d-4b13-9f3f-91f41c266485 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:57.667748 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ff0edf03-261d-4b13-9f3f-91f41c266485 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041176 Jul 01 07:16:57.668281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 426/898] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:16:57 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:16:57.728567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-08c7be7f-2a2b-4b0b-83a8-5e80bc39533d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:57.729061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-08c7be7f-2a2b-4b0b-83a8-5e80bc39533d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:57.735482 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-08c7be7f-2a2b-4b0b-83a8-5e80bc39533d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:57.735933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-08c7be7f-2a2b-4b0b-83a8-5e80bc39533d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:57.737202 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-08c7be7f-2a2b-4b0b-83a8-5e80bc39533d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:57.737639 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-08c7be7f-2a2b-4b0b-83a8-5e80bc39533d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:57.762353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-08c7be7f-2a2b-4b0b-83a8-5e80bc39533d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:16:57.833948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-08c7be7f-2a2b-4b0b-83a8-5e80bc39533d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 204 len: 0 microversion: 2.1 time: 0.108960 Jul 01 07:16:57.834727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 473/899] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:16:57 2022] DELETE /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:16:57.842648 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a96400c5-22b9-4e07-91a6-a48e020253ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:57.843295 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a96400c5-22b9-4e07-91a6-a48e020253ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:57.849539 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a96400c5-22b9-4e07-91a6-a48e020253ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:57.849996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a96400c5-22b9-4e07-91a6-a48e020253ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:57.850761 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a96400c5-22b9-4e07-91a6-a48e020253ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:57.851290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a96400c5-22b9-4e07-91a6-a48e020253ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:57.976594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a96400c5-22b9-4e07-91a6-a48e020253ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:57.984188 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a96400c5-22b9-4e07-91a6-a48e020253ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1684 microversion: 2.1 time: 0.145435 Jul 01 07:16:57.984682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 427/900] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:57 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1684 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:16:59.002649 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2ff974ce-111e-49fd-8bbf-9790ddbc427e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:16:59.003424 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2ff974ce-111e-49fd-8bbf-9790ddbc427e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:16:59.009828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2ff974ce-111e-49fd-8bbf-9790ddbc427e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:59.010314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2ff974ce-111e-49fd-8bbf-9790ddbc427e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:59.011279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2ff974ce-111e-49fd-8bbf-9790ddbc427e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:16:59.011721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2ff974ce-111e-49fd-8bbf-9790ddbc427e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:16:59.142214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2ff974ce-111e-49fd-8bbf-9790ddbc427e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:16:59.149609 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2ff974ce-111e-49fd-8bbf-9790ddbc427e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1684 microversion: 2.1 time: 0.151723 Jul 01 07:16:59.150168 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 474/901] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:16:58 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:00.166683 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3fa0470d-0067-469b-910e-754399eff71d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:00.167326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3fa0470d-0067-469b-910e-754399eff71d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:00.173818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3fa0470d-0067-469b-910e-754399eff71d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:00.174265 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3fa0470d-0067-469b-910e-754399eff71d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:00.175038 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3fa0470d-0067-469b-910e-754399eff71d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:00.175472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3fa0470d-0067-469b-910e-754399eff71d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:00.300144 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3fa0470d-0067-469b-910e-754399eff71d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:00.307494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3fa0470d-0067-469b-910e-754399eff71d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1684 microversion: 2.1 time: 0.144665 Jul 01 07:17:00.308042 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 428/902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:00 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1684 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:01.325074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bf400d22-a197-43b1-8451-1fea0931f6af tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:01.325689 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bf400d22-a197-43b1-8451-1fea0931f6af tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:01.332816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf400d22-a197-43b1-8451-1fea0931f6af tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:01.333267 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf400d22-a197-43b1-8451-1fea0931f6af tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:01.334036 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf400d22-a197-43b1-8451-1fea0931f6af tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:01.334474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf400d22-a197-43b1-8451-1fea0931f6af tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:01.463792 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-bf400d22-a197-43b1-8451-1fea0931f6af tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:01.471848 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bf400d22-a197-43b1-8451-1fea0931f6af tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1684 microversion: 2.1 time: 0.150658 Jul 01 07:17:01.472407 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 475/903] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:01 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:02.487999 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-250142df-8eb1-4fd7-8e8e-726d3d78ce43 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:02.489097 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-250142df-8eb1-4fd7-8e8e-726d3d78ce43 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:02.497268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-250142df-8eb1-4fd7-8e8e-726d3d78ce43 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:02.497723 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-250142df-8eb1-4fd7-8e8e-726d3d78ce43 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:02.498500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-250142df-8eb1-4fd7-8e8e-726d3d78ce43 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:02.499619 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-250142df-8eb1-4fd7-8e8e-726d3d78ce43 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:02.629193 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-250142df-8eb1-4fd7-8e8e-726d3d78ce43 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:02.636689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-250142df-8eb1-4fd7-8e8e-726d3d78ce43 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1684 microversion: 2.1 time: 0.152849 Jul 01 07:17:02.637238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 429/904] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:02 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:03.653387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-114b0193-e2e9-4381-a6be-2a17ae8eed29 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:03.653996 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-114b0193-e2e9-4381-a6be-2a17ae8eed29 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:03.661048 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-114b0193-e2e9-4381-a6be-2a17ae8eed29 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:03.661496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-114b0193-e2e9-4381-a6be-2a17ae8eed29 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:03.662257 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-114b0193-e2e9-4381-a6be-2a17ae8eed29 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:03.662694 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-114b0193-e2e9-4381-a6be-2a17ae8eed29 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:03.731022 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-114b0193-e2e9-4381-a6be-2a17ae8eed29 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:03.740031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-114b0193-e2e9-4381-a6be-2a17ae8eed29 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 200 len: 1616 microversion: 2.1 time: 0.090448 Jul 01 07:17:03.740822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 476/905] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:03 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 1616 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:03.782360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-634643cb-9574-47cd-beb9-f1aa7cd94083 req-26e642ec-8527-400a-99a2-2e3c2419bb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55170f1a-b683-46b7-955c-60a9344796e2", "name": "network-vif-deleted", "tag": "a8468059-7832-44f4-a4d0-9c2bd31379e3"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:03.791360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-634643cb-9574-47cd-beb9-f1aa7cd94083 req-26e642ec-8527-400a-99a2-2e3c2419bb7f service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:03.791874 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-634643cb-9574-47cd-beb9-f1aa7cd94083 req-26e642ec-8527-400a-99a2-2e3c2419bb7f service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:03.803215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-634643cb-9574-47cd-beb9-f1aa7cd94083 req-26e642ec-8527-400a-99a2-2e3c2419bb7f service nova] Creating event network-vif-deleted:a8468059-7832-44f4-a4d0-9c2bd31379e3 for instance 55170f1a-b683-46b7-955c-60a9344796e2 on hv-cinder-80721 Jul 01 07:17:03.808377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-634643cb-9574-47cd-beb9-f1aa7cd94083 req-26e642ec-8527-400a-99a2-2e3c2419bb7f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029502 Jul 01 07:17:03.809219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 430/906] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:04.757114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:04.757721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:04.764114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:04.764565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:04.765446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:04.765887 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:04.779149 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 HTTP/1.1 Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:17:04.780786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:17:04.782516 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '55170f1a-b683-46b7-955c-60a9344796e2'} Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:17:04.783496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:17:04.785652 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:04.787308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:17:04.787308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c3cd391c-06d4-4bb9-8e27-93ad6a41799b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 404 len: 111 microversion: 2.1 time: 0.028900 Jul 01 07:17:04.787308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 477/907] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:04 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:17:04.792639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f0dae043-85b9-4647-94df-765ea9d69941 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '.version_select at 0x7f2c4a2b9c10>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:04.811340 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f0dae043-85b9-4647-94df-765ea9d69941 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1560886393" status: 202 len: 0 microversion: 2.1 time: 0.023457 Jul 01 07:17:04.811863 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 431/908] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jul 1 07:17:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1560886393 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 07:17:05.629651 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-53ac6429-f99f-41f3-89b5-b77e8e3d4525 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: .version_select at 0x7f2c4a34a940>, body: {"keypair": {"name": "tempest-keypair-223678315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlYM52iIAv+hlZ5Ef7yNyiAEOS8+HPjGKCOp9QgfQNcOF6k2uym/4gZ4a+nx9OLomVVdCmB3NwhM9BPdwCb+DVNm7tTU/XYckpGxrlGnmS1AS5T4niFzJkHshqwfFVKww=="}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:05.643988 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-53ac6429-f99f-41f3-89b5-b77e8e3d4525 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for project dc0aa7206a704d45a610dccc24ec8767. Resources: {'key_pairs'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:17:05.647745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-53ac6429-f99f-41f3-89b5-b77e8e3d4525 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for user df44f27783d34370ad83470ffde558a8 and project dc0aa7206a704d45a610dccc24ec8767. Resources: {'key_pairs'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:17:05.668363 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-53ac6429-f99f-41f3-89b5-b77e8e3d4525 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043102 Jul 01 07:17:05.668928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 478/909] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:17:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:06.914268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1183554638", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f720862-6697-4120-b152-2a0712a988e8"}], "security_groups": [{"name": "tempest-securitygroup--1317626381"}], "key_name": "tempest-keypair-223678315", "user_data": "}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:07.012689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] validate_networks() for [('2f720862-6697-4120-b152-2a0712a988e8', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:17:07.383139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:17:07.383566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:17:07.384037 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:17:07.384475 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:17:07.384886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:17:07.394255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:07.394702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:07.395532 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:07.395971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:07.413193 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for project dc0aa7206a704d45a610dccc24ec8767. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:17:07.417078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Getting quotas for user df44f27783d34370ad83470ffde558a8 and project dc0aa7206a704d45a610dccc24ec8767. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:17:07.427803 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:17:07.430092 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:17:07.474602 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fe7ac1c6-a04b-4d9f-8acb-3bd668a03085 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565270 Jul 01 07:17:07.475269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 432/910] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:17:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:17:07.485740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5f172d67-6bf3-46ab-a62c-9b689f4f6d95 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:07.486360 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5f172d67-6bf3-46ab-a62c-9b689f4f6d95 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:07.540640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5f172d67-6bf3-46ab-a62c-9b689f4f6d95 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:07.548409 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5f172d67-6bf3-46ab-a62c-9b689f4f6d95 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1241 microversion: 2.1 time: 0.066976 Jul 01 07:17:07.548980 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 479/911] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:07 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:08.566293 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-231c5710-3524-46e1-a64e-1d038f5d7e81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:08.566939 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-231c5710-3524-46e1-a64e-1d038f5d7e81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:08.573207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-231c5710-3524-46e1-a64e-1d038f5d7e81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:08.573663 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-231c5710-3524-46e1-a64e-1d038f5d7e81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:08.574453 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-231c5710-3524-46e1-a64e-1d038f5d7e81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:08.574928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-231c5710-3524-46e1-a64e-1d038f5d7e81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:08.653509 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-231c5710-3524-46e1-a64e-1d038f5d7e81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:08.661383 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-231c5710-3524-46e1-a64e-1d038f5d7e81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1299 microversion: 2.1 time: 0.099562 Jul 01 07:17:08.661942 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 433/912] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:08 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:09.679063 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6c74970a-f2ee-42de-b281-1401412a9d59 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:09.679667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6c74970a-f2ee-42de-b281-1401412a9d59 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:09.686478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6c74970a-f2ee-42de-b281-1401412a9d59 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:09.686956 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6c74970a-f2ee-42de-b281-1401412a9d59 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:09.687725 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6c74970a-f2ee-42de-b281-1401412a9d59 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:09.688155 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6c74970a-f2ee-42de-b281-1401412a9d59 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:09.894283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6c74970a-f2ee-42de-b281-1401412a9d59 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:09.901735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6c74970a-f2ee-42de-b281-1401412a9d59 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.227282 Jul 01 07:17:09.902321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 480/913] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:09 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:10.016827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-93ac9fb7-b44d-4371-beee-16fb21b1c127 req-3b04ca25-d5a8-4c00-8827-001603f2af37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2d5241-6c37-4aaf-899e-e15e94655df5", "tag": "c39b2aa4-3dc3-42a9-86c2-2b59109a5991"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:10.026034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-93ac9fb7-b44d-4371-beee-16fb21b1c127 req-3b04ca25-d5a8-4c00-8827-001603f2af37 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:10.026808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-93ac9fb7-b44d-4371-beee-16fb21b1c127 req-3b04ca25-d5a8-4c00-8827-001603f2af37 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:10.039321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-93ac9fb7-b44d-4371-beee-16fb21b1c127 req-3b04ca25-d5a8-4c00-8827-001603f2af37 service nova] Creating event network-changed:c39b2aa4-3dc3-42a9-86c2-2b59109a5991 for instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 on hv-cinder-80721 Jul 01 07:17:10.044347 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-93ac9fb7-b44d-4371-beee-16fb21b1c127 req-3b04ca25-d5a8-4c00-8827-001603f2af37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032029 Jul 01 07:17:10.044950 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 434/914] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:10.918229 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-fce3cdc2-ea69-4bb7-9364-646cd9e633ee tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:10.918894 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-fce3cdc2-ea69-4bb7-9364-646cd9e633ee tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:10.925379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fce3cdc2-ea69-4bb7-9364-646cd9e633ee tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:10.925822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fce3cdc2-ea69-4bb7-9364-646cd9e633ee tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:10.926581 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fce3cdc2-ea69-4bb7-9364-646cd9e633ee tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:10.927041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-fce3cdc2-ea69-4bb7-9364-646cd9e633ee tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:11.052228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-fce3cdc2-ea69-4bb7-9364-646cd9e633ee tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:11.059863 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-fce3cdc2-ea69-4bb7-9364-646cd9e633ee tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.145520 Jul 01 07:17:11.060424 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 481/915] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:10 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:12.077549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-59e3645f-ae84-4a4e-b6a6-578ca9a305cf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:12.078246 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-59e3645f-ae84-4a4e-b6a6-578ca9a305cf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:12.085010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-59e3645f-ae84-4a4e-b6a6-578ca9a305cf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:12.085465 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-59e3645f-ae84-4a4e-b6a6-578ca9a305cf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:12.086221 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-59e3645f-ae84-4a4e-b6a6-578ca9a305cf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:12.086712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-59e3645f-ae84-4a4e-b6a6-578ca9a305cf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:12.219783 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-59e3645f-ae84-4a4e-b6a6-578ca9a305cf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:12.227077 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-59e3645f-ae84-4a4e-b6a6-578ca9a305cf tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.154217 Jul 01 07:17:12.227633 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 435/916] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:12 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:13.244014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f7a74a8b-1107-483e-b3e8-91a29d0f1b70 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:13.244637 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f7a74a8b-1107-483e-b3e8-91a29d0f1b70 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:13.251181 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f7a74a8b-1107-483e-b3e8-91a29d0f1b70 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:13.251616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f7a74a8b-1107-483e-b3e8-91a29d0f1b70 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:13.252381 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f7a74a8b-1107-483e-b3e8-91a29d0f1b70 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:13.252820 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f7a74a8b-1107-483e-b3e8-91a29d0f1b70 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:13.380262 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f7a74a8b-1107-483e-b3e8-91a29d0f1b70 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:13.387614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f7a74a8b-1107-483e-b3e8-91a29d0f1b70 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.147464 Jul 01 07:17:13.388180 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 482/917] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:13 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:14.404808 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-65878d7f-7c69-471e-a3bf-9d825ed17553 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:14.405416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-65878d7f-7c69-471e-a3bf-9d825ed17553 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:14.412428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-65878d7f-7c69-471e-a3bf-9d825ed17553 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:14.412879 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-65878d7f-7c69-471e-a3bf-9d825ed17553 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:14.413639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-65878d7f-7c69-471e-a3bf-9d825ed17553 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:14.414076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-65878d7f-7c69-471e-a3bf-9d825ed17553 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:14.539687 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-65878d7f-7c69-471e-a3bf-9d825ed17553 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:14.547040 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-65878d7f-7c69-471e-a3bf-9d825ed17553 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.146073 Jul 01 07:17:14.547591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 436/918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:14 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:15.564596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e21323c3-df99-40d4-901f-3cd5068f021f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:15.565247 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e21323c3-df99-40d4-901f-3cd5068f021f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:15.572448 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e21323c3-df99-40d4-901f-3cd5068f021f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:15.572903 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e21323c3-df99-40d4-901f-3cd5068f021f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:15.573671 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e21323c3-df99-40d4-901f-3cd5068f021f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:15.574108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e21323c3-df99-40d4-901f-3cd5068f021f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:15.707782 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e21323c3-df99-40d4-901f-3cd5068f021f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:15.715357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e21323c3-df99-40d4-901f-3cd5068f021f tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.154765 Jul 01 07:17:15.715917 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 483/919] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:15 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:16.731281 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a2c32192-cbd6-4aa9-9d93-d329ae273280 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:16.731897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a2c32192-cbd6-4aa9-9d93-d329ae273280 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:16.734253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:16.740529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a2c32192-cbd6-4aa9-9d93-d329ae273280 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:16.740982 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a2c32192-cbd6-4aa9-9d93-d329ae273280 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:16.741751 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a2c32192-cbd6-4aa9-9d93-d329ae273280 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:16.742191 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a2c32192-cbd6-4aa9-9d93-d329ae273280 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:16.745240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=65 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:16.872112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a2c32192-cbd6-4aa9-9d93-d329ae273280 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:16.880093 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a2c32192-cbd6-4aa9-9d93-d329ae273280 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.152695 Jul 01 07:17:16.880649 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 437/920] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:16 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:17.896563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-64fd7c15-ea67-4a90-8aaa-9b36fd612547 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:17.897182 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-64fd7c15-ea67-4a90-8aaa-9b36fd612547 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:17.899622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=6 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:17.900362 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:17.905916 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-64fd7c15-ea67-4a90-8aaa-9b36fd612547 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:17.906368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-64fd7c15-ea67-4a90-8aaa-9b36fd612547 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:17.907163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-64fd7c15-ea67-4a90-8aaa-9b36fd612547 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:17.907604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-64fd7c15-ea67-4a90-8aaa-9b36fd612547 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:17.912250 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:18.042220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-64fd7c15-ea67-4a90-8aaa-9b36fd612547 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:18.050111 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-64fd7c15-ea67-4a90-8aaa-9b36fd612547 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.157362 Jul 01 07:17:18.051312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 484/921] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:17 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:19.068159 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c74f92b4-e506-41c8-a80d-645da876df8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:19.068762 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c74f92b4-e506-41c8-a80d-645da876df8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:19.070748 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:19.071408 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=6 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:19.077806 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c74f92b4-e506-41c8-a80d-645da876df8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:19.078253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c74f92b4-e506-41c8-a80d-645da876df8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:19.079026 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c74f92b4-e506-41c8-a80d-645da876df8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:19.079464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c74f92b4-e506-41c8-a80d-645da876df8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:19.211356 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c74f92b4-e506-41c8-a80d-645da876df8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:19.219127 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c74f92b4-e506-41c8-a80d-645da876df8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.155221 Jul 01 07:17:19.219690 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 438/922] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:19 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:20.235176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-47fefaad-2bb5-4f9f-9514-5f3bdabdd8ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:20.235800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-47fefaad-2bb5-4f9f-9514-5f3bdabdd8ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:20.242243 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-47fefaad-2bb5-4f9f-9514-5f3bdabdd8ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:20.242691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-47fefaad-2bb5-4f9f-9514-5f3bdabdd8ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:20.243494 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-47fefaad-2bb5-4f9f-9514-5f3bdabdd8ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:20.243928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-47fefaad-2bb5-4f9f-9514-5f3bdabdd8ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:20.382210 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-47fefaad-2bb5-4f9f-9514-5f3bdabdd8ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:20.389909 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-47fefaad-2bb5-4f9f-9514-5f3bdabdd8ea tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.158453 Jul 01 07:17:20.390499 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 485/923] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:20 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:21.406742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-eb62ce37-1efc-46e4-9272-c18d8ee56ff9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:21.407356 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-eb62ce37-1efc-46e4-9272-c18d8ee56ff9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:21.414296 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eb62ce37-1efc-46e4-9272-c18d8ee56ff9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:21.414736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eb62ce37-1efc-46e4-9272-c18d8ee56ff9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:21.415531 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eb62ce37-1efc-46e4-9272-c18d8ee56ff9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:21.415977 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eb62ce37-1efc-46e4-9272-c18d8ee56ff9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:21.549801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-eb62ce37-1efc-46e4-9272-c18d8ee56ff9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:21.557187 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-eb62ce37-1efc-46e4-9272-c18d8ee56ff9 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.154326 Jul 01 07:17:21.557750 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 439/924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:21 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:21.849941 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-8b265a70-37d1-442c-a85e-6fc9c984db29 req-654ef2ae-6f85-47a8-8b84-d8207bd967b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2d5241-6c37-4aaf-899e-e15e94655df5", "name": "network-vif-plugged", "status": "completed", "tag": "c39b2aa4-3dc3-42a9-86c2-2b59109a5991"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:21.859533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-8b265a70-37d1-442c-a85e-6fc9c984db29 req-654ef2ae-6f85-47a8-8b84-d8207bd967b7 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:21.860055 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-8b265a70-37d1-442c-a85e-6fc9c984db29 req-654ef2ae-6f85-47a8-8b84-d8207bd967b7 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:21.871354 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-8b265a70-37d1-442c-a85e-6fc9c984db29 req-654ef2ae-6f85-47a8-8b84-d8207bd967b7 service nova] Creating event network-vif-plugged:c39b2aa4-3dc3-42a9-86c2-2b59109a5991 for instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 on hv-cinder-80721 Jul 01 07:17:21.876618 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-8b265a70-37d1-442c-a85e-6fc9c984db29 req-654ef2ae-6f85-47a8-8b84-d8207bd967b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 Jul 01 07:17:21.877290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 486/925] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:22.574058 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-47c12ed9-4913-4353-8d3c-fd65d83c27ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:22.574662 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-47c12ed9-4913-4353-8d3c-fd65d83c27ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:22.581158 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-47c12ed9-4913-4353-8d3c-fd65d83c27ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:22.581610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-47c12ed9-4913-4353-8d3c-fd65d83c27ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:22.582377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-47c12ed9-4913-4353-8d3c-fd65d83c27ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:22.582835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-47c12ed9-4913-4353-8d3c-fd65d83c27ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:22.713198 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-47c12ed9-4913-4353-8d3c-fd65d83c27ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:22.720526 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-47c12ed9-4913-4353-8d3c-fd65d83c27ff tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1367 microversion: 2.1 time: 0.150382 Jul 01 07:17:22.721076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 440/926] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:22 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:23.737987 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ffaa7d58-4e54-407c-9514-45c3b73cef90 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:23.738626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ffaa7d58-4e54-407c-9514-45c3b73cef90 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:23.745283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ffaa7d58-4e54-407c-9514-45c3b73cef90 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:23.745731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ffaa7d58-4e54-407c-9514-45c3b73cef90 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:23.746490 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ffaa7d58-4e54-407c-9514-45c3b73cef90 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:23.746960 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ffaa7d58-4e54-407c-9514-45c3b73cef90 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:23.871880 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ffaa7d58-4e54-407c-9514-45c3b73cef90 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:23.879280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ffaa7d58-4e54-407c-9514-45c3b73cef90 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1558 microversion: 2.1 time: 0.145558 Jul 01 07:17:23.879848 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 487/927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:23 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:23.896111 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8febd4eb-1f01-4b9b-aaaf-92b314f9e1eb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:23.896620 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8febd4eb-1f01-4b9b-aaaf-92b314f9e1eb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:23.902967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8febd4eb-1f01-4b9b-aaaf-92b314f9e1eb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:23.903423 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8febd4eb-1f01-4b9b-aaaf-92b314f9e1eb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:23.904194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8febd4eb-1f01-4b9b-aaaf-92b314f9e1eb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:23.904631 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8febd4eb-1f01-4b9b-aaaf-92b314f9e1eb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:23.980241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8febd4eb-1f01-4b9b-aaaf-92b314f9e1eb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088400 Jul 01 07:17:23.980844 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 441/928] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jul 1 07:17:23 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:25.098424 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-327def88-8e2a-4441-aa16-c0a0cc8d14aa req-4ea811a7-7b00-44a9-ac5b-97f710b31f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2d5241-6c37-4aaf-899e-e15e94655df5", "tag": "c39b2aa4-3dc3-42a9-86c2-2b59109a5991"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:25.106865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-327def88-8e2a-4441-aa16-c0a0cc8d14aa req-4ea811a7-7b00-44a9-ac5b-97f710b31f46 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:25.107312 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-327def88-8e2a-4441-aa16-c0a0cc8d14aa req-4ea811a7-7b00-44a9-ac5b-97f710b31f46 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:25.118645 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-327def88-8e2a-4441-aa16-c0a0cc8d14aa req-4ea811a7-7b00-44a9-ac5b-97f710b31f46 service nova] Creating event network-changed:c39b2aa4-3dc3-42a9-86c2-2b59109a5991 for instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 on hv-cinder-80721 Jul 01 07:17:25.123422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-327def88-8e2a-4441-aa16-c0a0cc8d14aa req-4ea811a7-7b00-44a9-ac5b-97f710b31f46 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029135 Jul 01 07:17:25.124024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 488/929] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:29.232211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-45f6cc1c-659c-4642-810e-e9164fe70ffe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:29.232758 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-45f6cc1c-659c-4642-810e-e9164fe70ffe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:29.234796 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-a4999996-6ada-475f-9c3b-20e1c69fd106 req-2efbef9f-9b0b-41ce-90c6-0c90b26945e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "456ae774-27ea-4a7a-a785-7b0f83ffa4b7", "tag": "6cada016-8f00-4c9f-903c-e0d5b5b84f89"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:29.239389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-45f6cc1c-659c-4642-810e-e9164fe70ffe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:29.240115 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-45f6cc1c-659c-4642-810e-e9164fe70ffe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:29.240871 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-45f6cc1c-659c-4642-810e-e9164fe70ffe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:29.241368 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-45f6cc1c-659c-4642-810e-e9164fe70ffe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:29.243753 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-a4999996-6ada-475f-9c3b-20e1c69fd106 req-2efbef9f-9b0b-41ce-90c6-0c90b26945e0 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:29.244163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-a4999996-6ada-475f-9c3b-20e1c69fd106 req-2efbef9f-9b0b-41ce-90c6-0c90b26945e0 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:29.256721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-a4999996-6ada-475f-9c3b-20e1c69fd106 req-2efbef9f-9b0b-41ce-90c6-0c90b26945e0 service nova] Creating event network-changed:6cada016-8f00-4c9f-903c-e0d5b5b84f89 for instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 on hv-cinder-80721 Jul 01 07:17:29.262240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-a4999996-6ada-475f-9c3b-20e1c69fd106 req-2efbef9f-9b0b-41ce-90c6-0c90b26945e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Jul 01 07:17:29.263282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 489/930] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:29.271775 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-45f6cc1c-659c-4642-810e-e9164fe70ffe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:17:29.354152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-45f6cc1c-659c-4642-810e-e9164fe70ffe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "DELETE /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 204 len: 0 microversion: 2.1 time: 0.126411 Jul 01 07:17:29.358049 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 442/931] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:17:29 2022] DELETE /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:17:29.364717 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-26cc9253-c458-40e0-bfd9-4be08dbf6bdb tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:29.365386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-26cc9253-c458-40e0-bfd9-4be08dbf6bdb tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:29.372062 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-26cc9253-c458-40e0-bfd9-4be08dbf6bdb tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:29.372508 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-26cc9253-c458-40e0-bfd9-4be08dbf6bdb tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:29.373270 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-26cc9253-c458-40e0-bfd9-4be08dbf6bdb tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:29.373745 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-26cc9253-c458-40e0-bfd9-4be08dbf6bdb tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:29.504808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-26cc9253-c458-40e0-bfd9-4be08dbf6bdb tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:29.512397 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-26cc9253-c458-40e0-bfd9-4be08dbf6bdb tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.152719 Jul 01 07:17:29.512970 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 490/932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:29 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:30.530702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e33268af-dbdd-4422-a458-32dd395aee35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:30.531352 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e33268af-dbdd-4422-a458-32dd395aee35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:30.537760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e33268af-dbdd-4422-a458-32dd395aee35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:30.538217 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e33268af-dbdd-4422-a458-32dd395aee35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:30.539026 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e33268af-dbdd-4422-a458-32dd395aee35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:30.539468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e33268af-dbdd-4422-a458-32dd395aee35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:30.720089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e33268af-dbdd-4422-a458-32dd395aee35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:30.727594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e33268af-dbdd-4422-a458-32dd395aee35 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1568 microversion: 2.1 time: 0.201435 Jul 01 07:17:30.728139 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 443/933] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:30 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:31.745923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e767b015-fc0a-493f-9fbe-f4a25e4e340d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:31.746881 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e767b015-fc0a-493f-9fbe-f4a25e4e340d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:31.754464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e767b015-fc0a-493f-9fbe-f4a25e4e340d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:31.755131 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e767b015-fc0a-493f-9fbe-f4a25e4e340d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:31.756027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e767b015-fc0a-493f-9fbe-f4a25e4e340d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:31.756353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e767b015-fc0a-493f-9fbe-f4a25e4e340d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:31.854679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e767b015-fc0a-493f-9fbe-f4a25e4e340d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a36e02c916b494180e68d3f231ee714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8def43018744d7b8d5a5f422e44bf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:31.867871 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-ab7c9795-a5e7-4574-8a56-d6d985323022 req-fec7a55c-2905-4b7b-a5ca-1fcea0d0e97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456ae774-27ea-4a7a-a785-7b0f83ffa4b7", "name": "network-vif-deleted", "tag": "6cada016-8f00-4c9f-903c-e0d5b5b84f89"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:31.870591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e767b015-fc0a-493f-9fbe-f4a25e4e340d tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 200 len: 1382 microversion: 2.1 time: 0.128704 Jul 01 07:17:31.871264 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 491/934] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:31 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 1382 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:31.878845 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-ab7c9795-a5e7-4574-8a56-d6d985323022 req-fec7a55c-2905-4b7b-a5ca-1fcea0d0e97b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:31.879296 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-ab7c9795-a5e7-4574-8a56-d6d985323022 req-fec7a55c-2905-4b7b-a5ca-1fcea0d0e97b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:31.892799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-ab7c9795-a5e7-4574-8a56-d6d985323022 req-fec7a55c-2905-4b7b-a5ca-1fcea0d0e97b service nova] Creating event network-vif-deleted:6cada016-8f00-4c9f-903c-e0d5b5b84f89 for instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 on hv-cinder-80721 Jul 01 07:17:31.898310 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-ab7c9795-a5e7-4574-8a56-d6d985323022 req-fec7a55c-2905-4b7b-a5ca-1fcea0d0e97b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Jul 01 07:17:31.899144 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 444/935] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:17:32.888321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:32.888933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] [instance: 456ae774-27ea-4a7a-a785-7b0f83ffa4b7] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:32.894978 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:32.895528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:32.896297 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:32.896733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:32.909706 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] HTTP exception thrown: Instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 could not be found. Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Request method failure captured: Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 HTTP/1.1 Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp3tBC_WGqe5sVrPSXixDUlXDdzHx8uoqN6RSPNvWfG4RWsyZfHkX7gy5O0h9gmNEl8ai3Hglz2XiNtnW409--ZdnKxa2BlH_3YMtdXd2WFQUu-XeEhQEtxrSFrA2Vi5Lp-Eu6pe9uk76e4CxmgXk4A6ggg-C6b3DSlYH-66c2wpqxA Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: d8def43018744d7b8d5a5f422e44bf89 Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-TestShelveInstance-756527592 Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:17:32.911340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d8def43018744d7b8d5a5f422e44bf89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d8def43018744d7b8d5a5f422e44bf89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d8def43018744d7b8d5a5f422e44bf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d8def43018744d7b8d5a5f422e44bf89"}]}] Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-TestShelveInstance-756527592 Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: d8def43018744d7b8d5a5f422e44bf89 Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-TestShelveInstance-756527592 Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-TestShelveInstance-756527592-project Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 0a36e02c916b494180e68d3f231ee714 Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-TestShelveInstance-756527592-project Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 could not be found. Jul 01 07:17:32.913019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '456ae774-27ea-4a7a-a785-7b0f83ffa4b7'} Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 could not be found. Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:17:32.913993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 could not be found. Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 could not be found. Jul 01 07:17:32.915385 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:32.916567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Returning 404 to user: Instance 456ae774-27ea-4a7a-a785-7b0f83ffa4b7 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:17:32.916567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ddedc27c-0f39-49fc-b06d-9a40525d5b76 tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7" status: 404 len: 111 microversion: 2.1 time: 0.028816 Jul 01 07:17:32.916567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 492/936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:32 2022] GET /compute/v2.1/servers/456ae774-27ea-4a7a-a785-7b0f83ffa4b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:17:33.074953 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-71b76616-a45e-404d-8b0d-d0625b5b15fe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] Calling method '.version_select at 0x7f2c4a48b790>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:33.094374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-71b76616-a45e-404d-8b0d-d0625b5b15fe tempest-TestShelveInstance-756527592 tempest-TestShelveInstance-756527592-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1681175753" status: 202 len: 0 microversion: 2.1 time: 0.023438 Jul 01 07:17:33.095202 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 445/937] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jul 1 07:17:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1681175753 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:17:40.317753 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8ca8ca92-6bfc-4988-9bd7-d477e4806b73 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1008703368"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:40.318928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8ca8ca92-6bfc-4988-9bd7-d477e4806b73 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:40.325005 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ca8ca92-6bfc-4988-9bd7-d477e4806b73 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:40.325461 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ca8ca92-6bfc-4988-9bd7-d477e4806b73 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:40.326228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ca8ca92-6bfc-4988-9bd7-d477e4806b73 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:40.326660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ca8ca92-6bfc-4988-9bd7-d477e4806b73 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:40.455626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.network.security_group_api [None req-8ca8ca92-6bfc-4988-9bd7-d477e4806b73 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Removing security group 4a576056-5dd2-4d1f-afe7-f51a18558b76 from port a0ad1989-7e46-4e7a-a4e2-e30646d4df95 Jul 01 07:17:40.834513 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8ca8ca92-6bfc-4988-9bd7-d477e4806b73 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "POST /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/action" status: 202 len: 0 microversion: 2.1 time: 0.519888 Jul 01 07:17:40.836118 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 493/938] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:17:40 2022] POST /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:17:40.849860 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-b2520b3c-f92f-4e15-8ccb-0e2fa6cbbbf3 req-32077d53-7bbf-4149-9137-d8208a95e896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a035c87f-f7c1-4663-babc-7e64de9f1718", "tag": "a0ad1989-7e46-4e7a-a4e2-e30646d4df95"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:40.874375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-b2520b3c-f92f-4e15-8ccb-0e2fa6cbbbf3 req-32077d53-7bbf-4149-9137-d8208a95e896 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:40.875158 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-b2520b3c-f92f-4e15-8ccb-0e2fa6cbbbf3 req-32077d53-7bbf-4149-9137-d8208a95e896 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:40.903899 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-b2520b3c-f92f-4e15-8ccb-0e2fa6cbbbf3 req-32077d53-7bbf-4149-9137-d8208a95e896 service nova] Creating event network-changed:a0ad1989-7e46-4e7a-a4e2-e30646d4df95 for instance a035c87f-f7c1-4663-babc-7e64de9f1718 on hv-cinder-80721 Jul 01 07:17:40.915643 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-b2520b3c-f92f-4e15-8ccb-0e2fa6cbbbf3 req-32077d53-7bbf-4149-9137-d8208a95e896 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069618 Jul 01 07:17:40.921382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 446/939] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:17:41.947463 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-dc910eab-7da2-4e3a-90b0-6ecd5cc25390 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:41.947843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-dc910eab-7da2-4e3a-90b0-6ecd5cc25390 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:41.953667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc910eab-7da2-4e3a-90b0-6ecd5cc25390 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:41.954114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc910eab-7da2-4e3a-90b0-6ecd5cc25390 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:41.955447 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc910eab-7da2-4e3a-90b0-6ecd5cc25390 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:41.955883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dc910eab-7da2-4e3a-90b0-6ecd5cc25390 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:42.045162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-dc910eab-7da2-4e3a-90b0-6ecd5cc25390 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lazy-loading 'services' on Instance uuid a035c87f-f7c1-4663-babc-7e64de9f1718 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:17:42.133743 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-dc910eab-7da2-4e3a-90b0-6ecd5cc25390 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments/a959c0ee-6bb4-45bd-bbe9-2e4583d680ae" status: 202 len: 0 microversion: 2.1 time: 0.197200 Jul 01 07:17:42.134703 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 494/940] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:17:41 2022] DELETE /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments/a959c0ee-6bb4-45bd-bbe9-2e4583d680ae => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:17:42.143462 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7efe1ca5-5950-40ce-bfa5-1849d04ab938 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:42.144546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-d528dd0e-3b10-48ce-9107-4e2346cd5322 req-62c5d7ac-b20d-48b4-872f-f378547cdab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a035c87f-f7c1-4663-babc-7e64de9f1718", "tag": "a0ad1989-7e46-4e7a-a4e2-e30646d4df95"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:42.145031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7efe1ca5-5950-40ce-bfa5-1849d04ab938 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:42.151522 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7efe1ca5-5950-40ce-bfa5-1849d04ab938 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:42.152156 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7efe1ca5-5950-40ce-bfa5-1849d04ab938 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:42.153006 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7efe1ca5-5950-40ce-bfa5-1849d04ab938 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:42.153167 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-d528dd0e-3b10-48ce-9107-4e2346cd5322 req-62c5d7ac-b20d-48b4-872f-f378547cdab6 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:42.153667 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7efe1ca5-5950-40ce-bfa5-1849d04ab938 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:42.153795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-d528dd0e-3b10-48ce-9107-4e2346cd5322 req-62c5d7ac-b20d-48b4-872f-f378547cdab6 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:42.166510 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-d528dd0e-3b10-48ce-9107-4e2346cd5322 req-62c5d7ac-b20d-48b4-872f-f378547cdab6 service nova] Creating event network-changed:a0ad1989-7e46-4e7a-a4e2-e30646d4df95 for instance a035c87f-f7c1-4663-babc-7e64de9f1718 on hv-cinder-80721 Jul 01 07:17:42.171780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-d528dd0e-3b10-48ce-9107-4e2346cd5322 req-62c5d7ac-b20d-48b4-872f-f378547cdab6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230619 Jul 01 07:17:42.173502 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 447/941] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:42.186678 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7efe1ca5-5950-40ce-bfa5-1849d04ab938 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047412 Jul 01 07:17:42.187300 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 495/942] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:17:42 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:17:43.199352 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-85793567-53e4-4ebc-aa69-b808e32378b2 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:43.200238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-85793567-53e4-4ebc-aa69-b808e32378b2 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:43.206334 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-85793567-53e4-4ebc-aa69-b808e32378b2 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:43.206793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-85793567-53e4-4ebc-aa69-b808e32378b2 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:43.207582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-85793567-53e4-4ebc-aa69-b808e32378b2 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:43.208020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-85793567-53e4-4ebc-aa69-b808e32378b2 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:43.235904 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-85793567-53e4-4ebc-aa69-b808e32378b2 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041365 Jul 01 07:17:43.236448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 448/943] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:17:43 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:17:43.247500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:43.247997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:43.254332 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:43.254795 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:43.256215 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:43.256648 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:43.328909 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] HTTP exception thrown: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 is not attached to volume a959c0ee-6bb4-45bd-bbe9-2e4583d680ae Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Request method failure captured: Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: DELETE /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments/a959c0ee-6bb4-45bd-bbe9-2e4583d680ae HTTP/1.1 Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp5tMie2tjOHwuJnlhsrUEKswcSONem6stEn26F9W7_0RrjecGtBHplDmepiJy1Q6HdxcIMwCJiU7eSEzUKCQAkfU7qnGw3CQjuo5HtqTvfy2wrIxL2qpDuWlNwmf6jE7q61O3XiDNx5uaEHGEuVqK_vHk2xL_1LWFgEwGNOFzg713U Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: ce460f857d824071927f15e19cbb11e7 Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-TestMinimumBasicScenario-130477733 Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:17:43.331336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce460f857d824071927f15e19cbb11e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce460f857d824071927f15e19cbb11e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce460f857d824071927f15e19cbb11e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce460f857d824071927f15e19cbb11e7"}]}] Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-TestMinimumBasicScenario-130477733 Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: ce460f857d824071927f15e19cbb11e7 Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-TestMinimumBasicScenario-130477733 Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-TestMinimumBasicScenario-130477733-project Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 631f377cb70b454cbde19de83676f502 Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-TestMinimumBasicScenario-130477733-project Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:17:43.332921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 is not attached to volume a959c0ee-6bb4-45bd-bbe9-2e4583d680ae Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'server_id': 'a035c87f-f7c1-4663-babc-7e64de9f1718', 'id': 'a959c0ee-6bb4-45bd-bbe9-2e4583d680ae'} Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a959c0ee-6bb4-45bd-bbe9-2e4583d680ae. Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:17:43.333807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 is not attached to volume a959c0ee-6bb4-45bd-bbe9-2e4583d680ae Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 is not attached to volume a959c0ee-6bb4-45bd-bbe9-2e4583d680ae Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:43.335255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Returning 404 to user: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 is not attached to volume a959c0ee-6bb4-45bd-bbe9-2e4583d680ae {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:17:43.336378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7c127ff6-f71b-49b7-a2fa-8eb190ccfdfb tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments/a959c0ee-6bb4-45bd-bbe9-2e4583d680ae" status: 404 len: 154 microversion: 2.1 time: 0.089179 Jul 01 07:17:43.336378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 496/944] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:17:43 2022] DELETE /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718/os-volume_attachments/a959c0ee-6bb4-45bd-bbe9-2e4583d680ae => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:17:44.464458 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-de056e4c-b4a7-4406-a119-ba9847de980d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:44.464943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-de056e4c-b4a7-4406-a119-ba9847de980d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:44.471496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-de056e4c-b4a7-4406-a119-ba9847de980d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:44.471975 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-de056e4c-b4a7-4406-a119-ba9847de980d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:44.472741 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-de056e4c-b4a7-4406-a119-ba9847de980d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:44.473181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-de056e4c-b4a7-4406-a119-ba9847de980d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:44.498989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-de056e4c-b4a7-4406-a119-ba9847de980d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:17:44.573553 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-de056e4c-b4a7-4406-a119-ba9847de980d tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 204 len: 0 microversion: 2.1 time: 0.112643 Jul 01 07:17:44.574230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 449/945] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:17:44 2022] DELETE /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:17:44.582825 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-efeeb9df-c351-4a4a-9636-50ac6250aa3a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:44.584032 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-efeeb9df-c351-4a4a-9636-50ac6250aa3a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:44.590548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-efeeb9df-c351-4a4a-9636-50ac6250aa3a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:44.591028 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-efeeb9df-c351-4a4a-9636-50ac6250aa3a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:44.591793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-efeeb9df-c351-4a4a-9636-50ac6250aa3a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:44.592230 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-efeeb9df-c351-4a4a-9636-50ac6250aa3a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:44.723072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-efeeb9df-c351-4a4a-9636-50ac6250aa3a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:44.730434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-efeeb9df-c351-4a4a-9636-50ac6250aa3a tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1554 microversion: 2.1 time: 0.151688 Jul 01 07:17:44.731097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 497/946] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:44 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:17:45.748911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-af6c5ae7-1266-4440-bf1c-d98e31db7e50 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:45.749559 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-af6c5ae7-1266-4440-bf1c-d98e31db7e50 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:45.756130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-af6c5ae7-1266-4440-bf1c-d98e31db7e50 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:45.756581 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-af6c5ae7-1266-4440-bf1c-d98e31db7e50 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:45.757347 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-af6c5ae7-1266-4440-bf1c-d98e31db7e50 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:45.757784 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-af6c5ae7-1266-4440-bf1c-d98e31db7e50 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:45.884766 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-af6c5ae7-1266-4440-bf1c-d98e31db7e50 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:45.892232 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-af6c5ae7-1266-4440-bf1c-d98e31db7e50 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1554 microversion: 2.1 time: 0.147650 Jul 01 07:17:45.892796 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 450/947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:45 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:46.909771 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3f2dfc36-8683-428a-9ef1-3ad02a45c3c7 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:46.910386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3f2dfc36-8683-428a-9ef1-3ad02a45c3c7 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:46.917423 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f2dfc36-8683-428a-9ef1-3ad02a45c3c7 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:46.917874 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f2dfc36-8683-428a-9ef1-3ad02a45c3c7 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:46.918634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f2dfc36-8683-428a-9ef1-3ad02a45c3c7 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:46.919096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f2dfc36-8683-428a-9ef1-3ad02a45c3c7 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:47.082616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3f2dfc36-8683-428a-9ef1-3ad02a45c3c7 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631f377cb70b454cbde19de83676f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce460f857d824071927f15e19cbb11e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:47.090700 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3f2dfc36-8683-428a-9ef1-3ad02a45c3c7 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 200 len: 1554 microversion: 2.1 time: 0.184745 Jul 01 07:17:47.091301 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 498/948] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:46 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:17:47.484782 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-b4f19748-bf0d-4793-b16c-18359af6b5af req-ffcf7571-b443-40bc-a8ea-4acaed44c52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a035c87f-f7c1-4663-babc-7e64de9f1718", "name": "network-vif-deleted", "tag": "a0ad1989-7e46-4e7a-a4e2-e30646d4df95"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:47.489506 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:47.496470 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-b4f19748-bf0d-4793-b16c-18359af6b5af req-ffcf7571-b443-40bc-a8ea-4acaed44c52b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:47.496919 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-b4f19748-bf0d-4793-b16c-18359af6b5af req-ffcf7571-b443-40bc-a8ea-4acaed44c52b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:47.502368 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:47.513224 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-b4f19748-bf0d-4793-b16c-18359af6b5af req-ffcf7571-b443-40bc-a8ea-4acaed44c52b service nova] Creating event network-vif-deleted:a0ad1989-7e46-4e7a-a4e2-e30646d4df95 for instance a035c87f-f7c1-4663-babc-7e64de9f1718 on hv-cinder-80721 Jul 01 07:17:47.519549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-b4f19748-bf0d-4793-b16c-18359af6b5af req-ffcf7571-b443-40bc-a8ea-4acaed44c52b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038429 Jul 01 07:17:47.520156 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 451/949] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:17:48.108727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:48.109342 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] [instance: a035c87f-f7c1-4663-babc-7e64de9f1718] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:48.111886 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=30 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:48.117942 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:48.118392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:48.119193 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:48.119630 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:48.123469 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:17:48.133964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] HTTP exception thrown: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 could not be found. Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Request method failure captured: Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 HTTP/1.1 Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp5tMie2tjOHwuJnlhsrUEKswcSONem6stEn26F9W7_0RrjecGtBHplDmepiJy1Q6HdxcIMwCJiU7eSEzUKCQAkfU7qnGw3CQjuo5HtqTvfy2wrIxL2qpDuWlNwmf6jE7q61O3XiDNx5uaEHGEuVqK_vHk2xL_1LWFgEwGNOFzg713U Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: ce460f857d824071927f15e19cbb11e7 Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-TestMinimumBasicScenario-130477733 Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:17:48.135534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce460f857d824071927f15e19cbb11e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce460f857d824071927f15e19cbb11e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce460f857d824071927f15e19cbb11e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce460f857d824071927f15e19cbb11e7"}]}] Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-TestMinimumBasicScenario-130477733 Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: ce460f857d824071927f15e19cbb11e7 Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-TestMinimumBasicScenario-130477733 Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-TestMinimumBasicScenario-130477733-project Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 631f377cb70b454cbde19de83676f502 Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-TestMinimumBasicScenario-130477733-project Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 could not be found. Jul 01 07:17:48.137163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': 'a035c87f-f7c1-4663-babc-7e64de9f1718'} Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 could not be found. Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:17:48.138157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 could not be found. Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 could not be found. Jul 01 07:17:48.139666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:17:48.141176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Returning 404 to user: Instance a035c87f-f7c1-4663-babc-7e64de9f1718 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:17:48.141176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-73dd979d-be17-49d2-8b30-2d4d00a0faf0 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718" status: 404 len: 111 microversion: 2.1 time: 0.032432 Jul 01 07:17:48.141176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 499/950] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:17:48 2022] GET /compute/v2.1/servers/a035c87f-f7c1-4663-babc-7e64de9f1718 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:17:48.146244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9dea7bc5-71c1-4198-90b8-9ae09752f728 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] Calling method '.version_select at 0x7f2c4a2ae4c0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:48.166529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9dea7bc5-71c1-4198-90b8-9ae09752f728 tempest-TestMinimumBasicScenario-130477733 tempest-TestMinimumBasicScenario-130477733-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1914254518" status: 202 len: 0 microversion: 2.1 time: 0.024516 Jul 01 07:17:48.167158 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 452/951] 10.222.0.48 () {58 vars in 1271 bytes} [Fri Jul 1 07:17:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1914254518 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:17:50.766126 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8d328074-2e3c-4477-ac62-212dc88d8c97 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:50.766788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8d328074-2e3c-4477-ac62-212dc88d8c97 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:50.773973 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d328074-2e3c-4477-ac62-212dc88d8c97 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:50.774591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d328074-2e3c-4477-ac62-212dc88d8c97 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:50.775396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d328074-2e3c-4477-ac62-212dc88d8c97 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:50.775920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8d328074-2e3c-4477-ac62-212dc88d8c97 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:50.803610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8d328074-2e3c-4477-ac62-212dc88d8c97 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/ips" status: 200 len: 152 microversion: 2.20 time: 0.040100 Jul 01 07:17:50.804202 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 500/952] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jul 1 07:17:50 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:17:52.635215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f16e4dda-f562-4baf-9d2b-aed07c8df9b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:17:52.635982 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f16e4dda-f562-4baf-9d2b-aed07c8df9b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:52.641992 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f16e4dda-f562-4baf-9d2b-aed07c8df9b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:52.642436 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f16e4dda-f562-4baf-9d2b-aed07c8df9b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:52.643211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f16e4dda-f562-4baf-9d2b-aed07c8df9b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:52.643641 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f16e4dda-f562-4baf-9d2b-aed07c8df9b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:52.666137 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-f16e4dda-f562-4baf-9d2b-aed07c8df9b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lazy-loading 'flavor' on Instance uuid 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:17:52.937224 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f16e4dda-f562-4baf-9d2b-aed07c8df9b3 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/action" status: 202 len: 0 microversion: 2.20 time: 0.306989 Jul 01 07:17:52.937858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 453/953] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jul 1 07:17:52 2022] POST /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:17:52.946359 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:52.947591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:52.955940 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:52.956792 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:52.957752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:52.958386 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:53.177763 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:53.186064 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:53.187604 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:53.188771 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d47930df-b922-4039-945f-38abac5948f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.246850 Jul 01 07:17:53.189510 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 501/954] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:17:52 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:17:54.212472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:54.213247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:54.220406 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:54.221112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:54.221909 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:54.222354 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:54.425443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:54.434314 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:54.435894 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:54.437062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ab75579d-835f-4651-8da9-e4ce418ff94d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.232787 Jul 01 07:17:54.437617 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 454/955] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:17:54 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:17:55.455204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:55.455898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:55.462912 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:55.463359 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:55.464117 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:55.464610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:55.612641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:55.623506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:55.625378 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:55.627421 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4311d55d-efe3-4a4d-b87b-a4c6092f6080 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.175424 Jul 01 07:17:55.628391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 502/956] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:17:55 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:17:56.647936 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:56.648540 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:56.655024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:56.655472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:56.656226 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:56.656679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:56.781365 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:56.789800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:56.791324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:56.792503 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-865ebead-7aef-48ef-99c1-467d63efb06d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.149140 Jul 01 07:17:56.793054 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 455/957] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:17:56 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:17:57.810617 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:57.811172 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:57.818163 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:57.818611 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:57.819397 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:57.819835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:57.950126 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:57.958610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:57.960178 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:57.961336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-14730ab6-8745-4baf-9ac8-5aed3e60d34b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.155003 Jul 01 07:17:57.961890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 503/958] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:17:57 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:17:58.979972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:17:58.980631 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:17:58.987030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:58.987483 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:58.988246 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:17:58.988683 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:17:59.116867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:59.124666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:59.126154 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:17:59.127364 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-24a22162-fdaa-43d5-a78d-931fb2befafc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.151332 Jul 01 07:17:59.127911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 456/959] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:17:58 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:00.145360 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:00.145972 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:00.152416 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:00.152858 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:00.153607 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:00.154037 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:00.279115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:00.287583 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:00.289077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:00.290236 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-50dbd3a3-05da-494d-b977-35cfca8d03cd tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.148814 Jul 01 07:18:00.290788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 504/960] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:00 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:01.308732 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:01.309605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:01.316225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:01.316674 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:01.318076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:01.318507 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:01.447899 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:01.455767 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:01.457265 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:01.458418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8160961c-aa47-4d79-b980-9740f27129f5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.153598 Jul 01 07:18:01.459011 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 457/961] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:01 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:02.476442 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:02.477090 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:02.483621 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:02.484075 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:02.484851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:02.485292 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:02.612565 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:02.620375 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:02.621891 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:02.623080 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b19fb392-497c-41af-a857-bdfa4f324872 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.150558 Jul 01 07:18:02.623640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 505/962] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:02 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:03.641546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:03.642149 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:03.648787 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:03.649234 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:03.649987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:03.650417 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:03.781783 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:03.790521 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:03.792117 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:03.793291 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7b60e4fc-b850-42a9-bada-6f34c9b5324a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.155832 Jul 01 07:18:03.793853 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 458/963] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:03 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:04.811782 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:04.812393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:04.818968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:04.819417 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:04.820180 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:04.820616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:04.945747 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:04.953664 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:04.955201 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:04.956357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7dcccadc-7ceb-4ce4-92ae-9ce4f7d2525b tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1745 microversion: 2.20 time: 0.148790 Jul 01 07:18:04.956926 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 506/964] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:04 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:05.974624 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:05.975295 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:05.981791 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:05.982240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:05.983038 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:05.983475 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:06.127402 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:06.135614 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:06.137128 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:06.138438 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-19ced93a-7f5f-459c-b16b-d7526739fd08 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1745 microversion: 2.20 time: 0.167614 Jul 01 07:18:06.139034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 459/965] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:05 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:07.156427 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:07.157048 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:07.164153 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:07.164601 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:07.165360 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:07.165789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:07.298226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:07.306239 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:07.307807 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:07.309222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-554d2cf6-178b-4cfe-aa7a-bd9eeb074e1e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1745 microversion: 2.20 time: 0.156453 Jul 01 07:18:07.309794 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 507/966] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:07 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:08.116375 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-3aba9baa-b896-4fc4-bd05-27d0292472e0 req-4ef24006-753e-4dbd-b060-461383d6a5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cecf2b-81c9-42be-9f7c-a2b9c74f1d76", "name": "network-vif-plugged", "status": "completed", "tag": "124d2096-5c39-4eaf-8073-f7d321f44142"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:18:08.125285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-3aba9baa-b896-4fc4-bd05-27d0292472e0 req-4ef24006-753e-4dbd-b060-461383d6a5ae service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:08.125878 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-3aba9baa-b896-4fc4-bd05-27d0292472e0 req-4ef24006-753e-4dbd-b060-461383d6a5ae service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:08.137062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-3aba9baa-b896-4fc4-bd05-27d0292472e0 req-4ef24006-753e-4dbd-b060-461383d6a5ae service nova] Creating event network-vif-plugged:124d2096-5c39-4eaf-8073-f7d321f44142 for instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 on hv-cinder-80721 Jul 01 07:18:08.142035 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-3aba9baa-b896-4fc4-bd05-27d0292472e0 req-4ef24006-753e-4dbd-b060-461383d6a5ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029421 Jul 01 07:18:08.142810 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 460/967] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:18:08.327234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:08.327778 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:08.334890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:08.335338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:08.336099 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:08.336532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:08.461856 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:08.469605 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:08.471114 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:08.472262 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5b60c8f2-37b6-4402-b2ac-c06764b4a357 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1745 microversion: 2.20 time: 0.148947 Jul 01 07:18:08.472810 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 508/968] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:08 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:09.491707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:09.492315 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:09.498583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:09.499085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:09.499827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:09.500270 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:09.635339 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:09.643125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:09.644620 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:09.645768 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e885f5f1-c747-4b29-af0c-7765051a6adc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.159472 Jul 01 07:18:09.646320 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 461/969] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:09 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:18:10.663815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:10.664429 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:10.671611 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:10.672068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:10.673059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:10.673506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:10.814527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:10.824148 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:10.825932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:10.827136 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-07c3107a-0f16-45f5-93c0-7bc3ee7db57e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.167168 Jul 01 07:18:10.827908 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 509/970] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:10 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:11.845738 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:11.846325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:11.854763 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:11.855319 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:11.856440 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:11.857244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:12.000015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:12.007917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:12.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:12.010564 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b3501f41-9e40-4de6-9102-b7877505d915 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.169208 Jul 01 07:18:12.011143 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 462/971] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:11 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:13.035484 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:13.036590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:13.043106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:13.043837 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:13.044822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:13.045464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:13.196795 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:13.213781 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:13.215844 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:13.217044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4152e41e-f36d-44c6-ba14-3de88c91f8fc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.185559 Jul 01 07:18:13.217964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 510/972] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:13 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:14.237276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:14.238422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:14.245407 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:14.246124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:14.247167 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:14.247609 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:14.402938 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:14.411446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:14.412979 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:14.414162 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f1ececfa-9807-4260-846b-7f3f09bcbc7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.180804 Jul 01 07:18:14.426182 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 463/973] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:14 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:15.432758 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:15.433379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:15.442419 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:15.442999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:15.443699 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:15.444181 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:15.765442 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:15.774505 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:15.776042 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:15.777216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-615cac01-a432-4271-a813-69735b526c28 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.348862 Jul 01 07:18:15.778078 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 511/974] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:15 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:16.795909 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:16.796524 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:16.803968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:16.804419 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:16.805190 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:16.805635 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:16.945444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:16.953749 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:16.958409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:16.959667 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1c3cda88-40b5-49ea-b7da-84df5dee8414 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.167670 Jul 01 07:18:16.960409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 464/975] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:16 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:17.977926 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:17.978547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:17.985410 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:17.985869 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:17.986654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:17.987165 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:18.133166 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:18.141977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:18.148039 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:18.149311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8f49f69d-1036-494f-b35e-dcb2ac7d1013 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.175443 Jul 01 07:18:18.149949 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 512/976] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:17 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:19.167987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:19.168605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:19.171004 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:18:19.176374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:19.176821 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:19.177585 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:19.178020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:19.181452 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:18:19.357378 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:19.365195 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:19.366708 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:19.367883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d84b0811-11a3-4666-a41e-7a7baba84616 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1740 microversion: 2.20 time: 0.203835 Jul 01 07:18:19.368442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 465/977] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:19 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:20.385860 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:20.386580 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:20.388949 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=28 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:18:20.394264 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:20.394712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:20.396061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:20.396496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:20.533809 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:20.541590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:20.543110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:20.544250 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5b2823ca-b829-415f-af19-dc4e80464c7d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1722 microversion: 2.20 time: 0.162268 Jul 01 07:18:20.544810 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 513/978] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:20 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:21.562672 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:21.563368 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:21.570038 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:21.570493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:21.571298 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:21.571740 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:21.697250 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:21.705050 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:21.706584 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:21.708282 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a483341e-48f5-473b-9712-ce13e7b13377 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1722 microversion: 2.20 time: 0.149252 Jul 01 07:18:21.708835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 466/979] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:21 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:22.726393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:22.727022 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:22.733422 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:22.733864 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:22.734621 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:22.735081 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:22.737591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=84 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:18:22.869961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:22.878822 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:22.880824 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:22.882024 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b118e870-84b0-466f-99c4-b7cd0b2e7433 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1665 microversion: 2.20 time: 0.159552 Jul 01 07:18:22.882697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 514/980] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:22 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:22.900073 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1f993970-85c1-4d02-a58e-134f8e4b52a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdcd3694-0772-4d39-a77b-693d637747c6"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:18:22.901125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1f993970-85c1-4d02-a58e-134f8e4b52a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:22.907516 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1f993970-85c1-4d02-a58e-134f8e4b52a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:22.907960 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1f993970-85c1-4d02-a58e-134f8e4b52a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:22.908717 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1f993970-85c1-4d02-a58e-134f8e4b52a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:22.909145 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1f993970-85c1-4d02-a58e-134f8e4b52a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:23.166241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1f993970-85c1-4d02-a58e-134f8e4b52a6 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.270721 Jul 01 07:18:23.166862 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 467/981] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jul 1 07:18:22 2022] POST /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/os-volume_attachments => generated 188 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 07:18:23.279923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8a61e142-ee04-4471-aa33-45da4320792d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:23.280421 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8a61e142-ee04-4471-aa33-45da4320792d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:23.286948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a61e142-ee04-4471-aa33-45da4320792d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:23.287398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a61e142-ee04-4471-aa33-45da4320792d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:23.288159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a61e142-ee04-4471-aa33-45da4320792d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:23.288590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a61e142-ee04-4471-aa33-45da4320792d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:23.529572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8a61e142-ee04-4471-aa33-45da4320792d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/os-volume_attachments/bdcd3694-0772-4d39-a77b-693d637747c6" status: 202 len: 0 microversion: 2.20 time: 0.253515 Jul 01 07:18:23.530210 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 515/982] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jul 1 07:18:23 2022] DELETE /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/os-volume_attachments/bdcd3694-0772-4d39-a77b-693d637747c6 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:18:23.585538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ab54f440-25e0-47d5-9c6e-2b05c7fb73b0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:18:23.586100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ab54f440-25e0-47d5-9c6e-2b05c7fb73b0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:23.592044 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ab54f440-25e0-47d5-9c6e-2b05c7fb73b0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:23.592490 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ab54f440-25e0-47d5-9c6e-2b05c7fb73b0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:23.593238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ab54f440-25e0-47d5-9c6e-2b05c7fb73b0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:23.593669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ab54f440-25e0-47d5-9c6e-2b05c7fb73b0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:23.668944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ab54f440-25e0-47d5-9c6e-2b05c7fb73b0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "POST /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/action" status: 202 len: 0 microversion: 2.20 time: 0.087460 Jul 01 07:18:23.669529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 468/983] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jul 1 07:18:23 2022] POST /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:18:23.677717 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:23.678333 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:23.685106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:23.685563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:23.686336 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:23.686785 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:23.821622 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:23.830804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:23.832480 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:23.834232 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8a108237-2525-4cca-9f6b-8b512da4579c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1673 microversion: 2.20 time: 0.160540 Jul 01 07:18:23.834914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 516/984] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:23 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:24.154920 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-cfc2ded5-3f0d-4afb-9da9-58ccf77f943a req-e88e2137-2f7e-4ee2-b577-2ff4d67a994e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cecf2b-81c9-42be-9f7c-a2b9c74f1d76", "name": "network-vif-unplugged", "status": "completed", "tag": "124d2096-5c39-4eaf-8073-f7d321f44142"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:18:24.163583 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-cfc2ded5-3f0d-4afb-9da9-58ccf77f943a req-e88e2137-2f7e-4ee2-b577-2ff4d67a994e service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:24.164025 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-cfc2ded5-3f0d-4afb-9da9-58ccf77f943a req-e88e2137-2f7e-4ee2-b577-2ff4d67a994e service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:24.175738 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.compute.server_external_events [req-cfc2ded5-3f0d-4afb-9da9-58ccf77f943a req-e88e2137-2f7e-4ee2-b577-2ff4d67a994e service nova] Unable to find a host for instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76. Dropping event network-vif-unplugged {{(pid=117836) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 07:18:24.177241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-cfc2ded5-3f0d-4afb-9da9-58ccf77f943a req-e88e2137-2f7e-4ee2-b577-2ff4d67a994e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026051 Jul 01 07:18:24.177826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 469/985] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 07:18:24.852784 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:24.853392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:24.859774 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:24.860221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:24.860976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:24.861403 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:25.062650 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:25.071298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:25.072790 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:25.073932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2f6ea05a-1fd2-4a54-984e-3e7d7555b073 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.225175 Jul 01 07:18:25.074524 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 517/986] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:24 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:26.093078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:26.093790 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:26.101228 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:26.101685 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:26.102456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:26.102935 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:26.242549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:26.251464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:26.252988 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:26.254311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1e304e80-93d1-4c87-94da-072e502fd6e5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.165173 Jul 01 07:18:26.255154 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 470/987] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:26 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:27.275959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:27.276627 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:27.284484 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:27.286495 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:27.287851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:27.288291 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:27.421408 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:27.432079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:27.434848 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:27.436400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9f760c76-8278-4550-9e1a-0b029302585a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.167867 Jul 01 07:18:27.437317 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 518/988] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:27 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:28.454684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:28.455931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:28.462677 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:28.463247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:28.463975 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:28.464418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:28.626605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:28.634876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:28.636515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:28.637643 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-43a5ad19-efeb-4baf-9112-ac4d48059839 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.186898 Jul 01 07:18:28.638207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 471/989] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:28 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:29.656002 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:29.656601 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:29.665878 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:29.666306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:29.668755 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:29.669209 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:29.807433 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:29.816666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:29.818334 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:29.819555 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-78c19f14-31e4-4dd0-9340-13df44b5dd8d tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.167454 Jul 01 07:18:29.826533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 519/990] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:29 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:30.815107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:18:30.815787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:18:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:18:30.837511 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:30.838125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:30.844830 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:30.845292 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:30.846064 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:30.846508 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:30.987099 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:30.995646 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:30.997164 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:30.998324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bf8632cc-82ee-46b5-afca-a23c13c37ba5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.164809 Jul 01 07:18:30.998917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 472/991] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:30 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:32.164737 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:32.165358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:32.174379 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:32.174867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:32.175657 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:32.176092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:32.326788 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:32.335761 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:32.337282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:32.338455 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8873c8fc-ef99-4ef1-a732-32293ab01264 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.325089 Jul 01 07:18:32.339222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 520/992] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:32 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:33.358089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:33.358752 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:33.366075 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:33.366522 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:33.367317 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:33.367752 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:33.503021 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:33.512498 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:33.514026 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:33.515226 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9ab52d9f-e17b-4c7d-ba14-9fab036c4851 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.161584 Jul 01 07:18:33.515782 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 473/993] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:33 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:34.533259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:34.534883 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:34.542597 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:34.543487 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:34.544999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:34.545696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:34.682299 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:34.690314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:34.691836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:34.693010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5d6dcedb-ab8b-4249-8373-6742c121e1ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.163713 Jul 01 07:18:34.693579 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 521/994] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:34 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:35.711424 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:35.712031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:35.718467 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:35.718955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:35.719716 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:35.720151 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:35.845872 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:35.854276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:35.855802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:35.856944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-91d98475-ebf1-4d19-b68e-d0aaef0880af tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.149978 Jul 01 07:18:35.857497 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 474/995] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:35 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:36.875640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:36.876274 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:36.882215 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:36.882663 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:36.883454 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:36.883890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:37.012793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:37.020588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:37.022097 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:37.023871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-74e79754-941d-478b-a983-25d54616132c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.152384 Jul 01 07:18:37.024419 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 522/996] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:36 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:38.042204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:38.042858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:38.049391 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:38.049839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:38.050594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:38.051057 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:38.177173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:38.185389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:38.186987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:38.188147 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b3afb9f1-ca25-4dcd-b778-9337040aa40f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.150366 Jul 01 07:18:38.188701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 475/997] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:38 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:39.206700 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:39.207322 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:39.218942 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:39.219404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:39.220186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:39.220619 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:39.363862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:39.371752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:39.373261 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:39.374452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-85a41006-ccc4-4da8-9a0a-10eb1fcf644f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.171769 Jul 01 07:18:39.375044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 523/998] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:39 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:40.026503 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-44ecf847-f016-4654-9958-e8f1f71574de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:40.027100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-44ecf847-f016-4654-9958-e8f1f71574de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:40.033456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-44ecf847-f016-4654-9958-e8f1f71574de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:40.033901 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-44ecf847-f016-4654-9958-e8f1f71574de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:40.034657 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-44ecf847-f016-4654-9958-e8f1f71574de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:40.035113 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-44ecf847-f016-4654-9958-e8f1f71574de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:40.057251 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-44ecf847-f016-4654-9958-e8f1f71574de tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/ips" status: 200 len: 151 microversion: 2.1 time: 0.035320 Jul 01 07:18:40.057812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 476/999] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:18:40 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:18:40.392347 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:40.392964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:40.399350 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:40.399798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:40.400561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:40.401000 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:40.527826 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:40.535671 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:40.537173 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:40.538911 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3b86d6aa-4578-4a49-9d27-e25236f284ff tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.150451 Jul 01 07:18:40.539468 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 524/1000] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:40 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:41.370580 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-449b0fa1-3456-4f57-bdb4-17c770204aa0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f8ac8b1-e06e-448e-82d8-1d8125178924"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:18:41.371687 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-449b0fa1-3456-4f57-bdb4-17c770204aa0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:41.378140 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-449b0fa1-3456-4f57-bdb4-17c770204aa0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:41.378591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-449b0fa1-3456-4f57-bdb4-17c770204aa0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:41.379400 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-449b0fa1-3456-4f57-bdb4-17c770204aa0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:41.379843 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-449b0fa1-3456-4f57-bdb4-17c770204aa0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:41.556834 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:41.557451 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:41.564216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:41.564679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:41.565534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:41.566249 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:41.627687 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:18:41.638664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-449b0fa1-3456-4f57-bdb4-17c770204aa0 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "POST /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271912 Jul 01 07:18:41.639304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 477/1001] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:18:41 2022] POST /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:18:41.707894 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:41.715806 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:41.717295 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:41.718444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3bf6bbbb-3654-4308-b481-685ebb66e0d5 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.165612 Jul 01 07:18:41.719159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 525/1002] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:41 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 07:18:42.737907 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:42.738594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:42.750646 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:42.751157 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:42.751944 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:42.752380 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:42.882973 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:42.890942 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:42.892449 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:42.893611 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1cbc042b-47c0-41af-916b-01aedf1e484f tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.161026 Jul 01 07:18:42.894162 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 478/1003] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:42 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:43.912118 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:43.912729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:43.919926 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:43.920380 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:43.921148 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:43.921726 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:44.049230 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:44.057607 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:44.059413 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:44.060561 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7bd3b97d-5cb8-4578-aa4b-e6f0d1d5155e tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.152322 Jul 01 07:18:44.061108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 526/1004] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:43 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:44.242282 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-6695161c-c319-4a48-aebd-3adfb3dd81c9 req-7c2c7bcc-85e3-46cb-a5af-5f9d36c13953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cecf2b-81c9-42be-9f7c-a2b9c74f1d76", "name": "network-vif-plugged", "status": "completed", "tag": "124d2096-5c39-4eaf-8073-f7d321f44142"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:18:44.252850 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-6695161c-c319-4a48-aebd-3adfb3dd81c9 req-7c2c7bcc-85e3-46cb-a5af-5f9d36c13953 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:44.253383 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-6695161c-c319-4a48-aebd-3adfb3dd81c9 req-7c2c7bcc-85e3-46cb-a5af-5f9d36c13953 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:44.266278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-6695161c-c319-4a48-aebd-3adfb3dd81c9 req-7c2c7bcc-85e3-46cb-a5af-5f9d36c13953 service nova] Creating event network-vif-plugged:124d2096-5c39-4eaf-8073-f7d321f44142 for instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 on hv-cinder-80721 Jul 01 07:18:44.271199 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-6695161c-c319-4a48-aebd-3adfb3dd81c9 req-7c2c7bcc-85e3-46cb-a5af-5f9d36c13953 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033061 Jul 01 07:18:44.271968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 479/1005] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:18:45.078013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:45.078627 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:45.085217 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:45.085672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:45.086443 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:45.086911 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:45.214335 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:45.222264 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:45.223804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:45.225026 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c2a04c30-dec8-4ef6-8354-367312431469 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.150967 Jul 01 07:18:45.225580 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 527/1006] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:45 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:46.244472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:46.245183 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:46.251871 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:46.252319 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:46.253083 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:46.253603 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:46.389559 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:46.397580 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:46.399132 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:46.400278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d0f3b627-9573-40f6-a7b3-dd386837b55c tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1731 microversion: 2.20 time: 0.160555 Jul 01 07:18:46.400830 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 480/1007] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:46 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:47.417937 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:47.418543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:47.425096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:47.425546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:47.426339 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:47.426793 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:47.430682 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:18:47.554919 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:47.563032 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:47.564549 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:47.565696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4f5569a4-1df1-477f-ba30-7572f5988283 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1718 microversion: 2.20 time: 0.151717 Jul 01 07:18:47.566259 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 528/1008] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:18:47 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:18:49.230616 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f32fd706-bd95-4625-96be-9de0eada8f5a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:49.231153 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f32fd706-bd95-4625-96be-9de0eada8f5a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:49.233629 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=34 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:18:49.239112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f32fd706-bd95-4625-96be-9de0eada8f5a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:49.239558 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f32fd706-bd95-4625-96be-9de0eada8f5a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:49.240312 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f32fd706-bd95-4625-96be-9de0eada8f5a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:49.240742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f32fd706-bd95-4625-96be-9de0eada8f5a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:49.320601 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.objects.instance [None req-f32fd706-bd95-4625-96be-9de0eada8f5a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lazy-loading 'services' on Instance uuid 7d2d5241-6c37-4aaf-899e-e15e94655df5 {{(pid=117836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:18:49.393411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f32fd706-bd95-4625-96be-9de0eada8f5a tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-volume_attachments/8f8ac8b1-e06e-448e-82d8-1d8125178924" status: 202 len: 0 microversion: 2.1 time: 0.166525 Jul 01 07:18:49.393993 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 481/1009] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:18:49 2022] DELETE /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-volume_attachments/8f8ac8b1-e06e-448e-82d8-1d8125178924 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:18:49.402096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e35fb5b8-7515-452e-bb94-224b5f5aa8bb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:49.403100 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e35fb5b8-7515-452e-bb94-224b5f5aa8bb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:49.409609 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e35fb5b8-7515-452e-bb94-224b5f5aa8bb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:49.410064 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e35fb5b8-7515-452e-bb94-224b5f5aa8bb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:49.411077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e35fb5b8-7515-452e-bb94-224b5f5aa8bb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:49.411529 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e35fb5b8-7515-452e-bb94-224b5f5aa8bb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:49.441530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e35fb5b8-7515-452e-bb94-224b5f5aa8bb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 Jul 01 07:18:49.442092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 529/1010] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:18:49 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:18:50.454860 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a875c7a1-3398-4d0d-b6d1-d4e65501f1cb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:50.456684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a875c7a1-3398-4d0d-b6d1-d4e65501f1cb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:50.464513 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a875c7a1-3398-4d0d-b6d1-d4e65501f1cb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:50.464969 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a875c7a1-3398-4d0d-b6d1-d4e65501f1cb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:50.465733 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a875c7a1-3398-4d0d-b6d1-d4e65501f1cb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:50.466167 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a875c7a1-3398-4d0d-b6d1-d4e65501f1cb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:50.494754 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a875c7a1-3398-4d0d-b6d1-d4e65501f1cb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044877 Jul 01 07:18:50.495260 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 482/1011] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:18:50 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:18:50.550701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-85db0d3c-09ae-4115-8cde-75c64764af8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:50.551230 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-85db0d3c-09ae-4115-8cde-75c64764af8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:50.553478 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=34 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:18:50.559487 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85db0d3c-09ae-4115-8cde-75c64764af8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:50.559931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85db0d3c-09ae-4115-8cde-75c64764af8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:50.560693 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85db0d3c-09ae-4115-8cde-75c64764af8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:50.561130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85db0d3c-09ae-4115-8cde-75c64764af8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:50.586058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-85db0d3c-09ae-4115-8cde-75c64764af8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:18:50.656623 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-85db0d3c-09ae-4115-8cde-75c64764af8d tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 204 len: 0 microversion: 2.1 time: 0.109409 Jul 01 07:18:50.657218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 530/1012] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:18:50 2022] DELETE /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:18:50.665468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b7ff5770-04ca-4177-abbe-1f9f6056e7c3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:50.666078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b7ff5770-04ca-4177-abbe-1f9f6056e7c3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:50.672246 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b7ff5770-04ca-4177-abbe-1f9f6056e7c3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:50.672704 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b7ff5770-04ca-4177-abbe-1f9f6056e7c3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:50.673459 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b7ff5770-04ca-4177-abbe-1f9f6056e7c3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:50.673906 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b7ff5770-04ca-4177-abbe-1f9f6056e7c3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:50.800519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b7ff5770-04ca-4177-abbe-1f9f6056e7c3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:50.808484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b7ff5770-04ca-4177-abbe-1f9f6056e7c3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1683 microversion: 2.1 time: 0.146888 Jul 01 07:18:50.809307 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 483/1013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:18:50 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:18:51.826954 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d3252dd5-4fff-4753-a621-717092badeab tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:51.827590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d3252dd5-4fff-4753-a621-717092badeab tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:51.834204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d3252dd5-4fff-4753-a621-717092badeab tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:51.834683 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d3252dd5-4fff-4753-a621-717092badeab tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:51.836074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d3252dd5-4fff-4753-a621-717092badeab tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:51.836502 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d3252dd5-4fff-4753-a621-717092badeab tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:51.964073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d3252dd5-4fff-4753-a621-717092badeab tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:51.971463 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d3252dd5-4fff-4753-a621-717092badeab tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1683 microversion: 2.1 time: 0.148784 Jul 01 07:18:51.972021 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 531/1014] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:18:51 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:18:52.988080 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6b36f97f-0aca-4e14-85c4-2d1d1cf7dc19 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:52.988624 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6b36f97f-0aca-4e14-85c4-2d1d1cf7dc19 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:52.995585 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6b36f97f-0aca-4e14-85c4-2d1d1cf7dc19 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:52.996039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6b36f97f-0aca-4e14-85c4-2d1d1cf7dc19 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:52.996811 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6b36f97f-0aca-4e14-85c4-2d1d1cf7dc19 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:52.997250 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6b36f97f-0aca-4e14-85c4-2d1d1cf7dc19 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:53.212984 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6b36f97f-0aca-4e14-85c4-2d1d1cf7dc19 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df44f27783d34370ad83470ffde558a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0aa7206a704d45a610dccc24ec8767', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:18:53.221923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6b36f97f-0aca-4e14-85c4-2d1d1cf7dc19 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 200 len: 1683 microversion: 2.1 time: 0.237566 Jul 01 07:18:53.221923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 484/1015] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:18:52 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:18:53.577027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-3c133b72-d9fd-438f-bfae-bde45350d842 req-d4cbaca5-b725-4a50-aca2-486169119ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2d5241-6c37-4aaf-899e-e15e94655df5", "name": "network-vif-deleted", "tag": "c39b2aa4-3dc3-42a9-86c2-2b59109a5991"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:18:53.584816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-3c133b72-d9fd-438f-bfae-bde45350d842 req-d4cbaca5-b725-4a50-aca2-486169119ba3 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:53.588082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-3c133b72-d9fd-438f-bfae-bde45350d842 req-d4cbaca5-b725-4a50-aca2-486169119ba3 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:53.602279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-3c133b72-d9fd-438f-bfae-bde45350d842 req-d4cbaca5-b725-4a50-aca2-486169119ba3 service nova] Creating event network-vif-deleted:c39b2aa4-3dc3-42a9-86c2-2b59109a5991 for instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 on hv-cinder-80721 Jul 01 07:18:53.609254 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-3c133b72-d9fd-438f-bfae-bde45350d842 req-d4cbaca5-b725-4a50-aca2-486169119ba3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036560 Jul 01 07:18:53.609868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 532/1016] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:18:54.239751 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:54.240374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:54.248007 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:54.248478 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:54.249245 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:54.249686 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:54.264570 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 HTTP/1.1 Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:18:54.266242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:54.267760 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '7d2d5241-6c37-4aaf-899e-e15e94655df5'} Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:54.268639 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:54.269996 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:54.271665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:54.271665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4400b0ad-d317-4b33-aeb2-76b950bea3fb tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 404 len: 111 microversion: 2.1 time: 0.031969 Jul 01 07:18:54.271665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 485/1017] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:18:54 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:18:54.278046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-91424197-db3b-4b5b-809d-4f87b13039b6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '.version_select at 0x7f2c4ec12790>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:54.295014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-91424197-db3b-4b5b-809d-4f87b13039b6 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-223678315" status: 202 len: 0 microversion: 2.1 time: 0.021128 Jul 01 07:18:54.295586 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 533/1018] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jul 1 07:18:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-223678315 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 07:18:56.031991 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:56.032515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:56.039633 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:56.040086 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:56.040853 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:56.041294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:56.056119 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: DELETE /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 HTTP/1.1 Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:18:56.057831 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.059719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '7d2d5241-6c37-4aaf-899e-e15e94655df5'} Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:56.060491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.061755 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.063041 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:56.063041 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-23c17374-3362-487e-af9f-55919e056ac3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 404 len: 111 microversion: 2.1 time: 0.031479 Jul 01 07:18:56.063041 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 486/1019] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:18:56 2022] DELETE /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:18:56.067920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:56.068684 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 7d2d5241-6c37-4aaf-899e-e15e94655df5] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:56.075508 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:56.075962 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:56.076742 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:56.077182 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:56.090981 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 HTTP/1.1 Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:18:56.092948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.094812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '7d2d5241-6c37-4aaf-899e-e15e94655df5'} Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:56.095731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. Jul 01 07:18:56.097226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:56.098547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 7d2d5241-6c37-4aaf-899e-e15e94655df5 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:56.098547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-73a375db-4bea-4b1a-9ff8-024ff7a5ca81 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5" status: 404 len: 111 microversion: 2.1 time: 0.029924 Jul 01 07:18:56.098547 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 534/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:18:56 2022] GET /compute/v2.1/servers/7d2d5241-6c37-4aaf-899e-e15e94655df5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:18:57.229519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:57.230024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:57.236402 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:57.236849 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:57.237602 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:57.238035 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:57.251209 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: DELETE /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 HTTP/1.1 Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:18:57.252722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.254418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '55170f1a-b683-46b7-955c-60a9344796e2'} Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:57.255285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.257304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.258812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:57.258812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-db7763c7-82d1-49f2-bb9a-145978e6dba3 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 404 len: 111 microversion: 2.1 time: 0.028392 Jul 01 07:18:57.258812 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 487/1021] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:18:57 2022] DELETE /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:18:57.262730 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:57.263364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 55170f1a-b683-46b7-955c-60a9344796e2] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:57.269762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:57.270213 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:57.271010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:57.271448 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:57.290187 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 HTTP/1.1 Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:18:57.291728 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.293399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '55170f1a-b683-46b7-955c-60a9344796e2'} Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:57.294507 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. Jul 01 07:18:57.296003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.297415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 55170f1a-b683-46b7-955c-60a9344796e2 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:57.297415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bed1168e-1d5f-47dc-9be8-590a2bf667f2 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2" status: 404 len: 111 microversion: 2.1 time: 0.034105 Jul 01 07:18:57.297415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 535/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:18:57 2022] GET /compute/v2.1/servers/55170f1a-b683-46b7-955c-60a9344796e2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 07:18:57.301529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:57.302024 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:57.308698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:57.309421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:57.310165 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:57.310602 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:57.324601 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: DELETE /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 HTTP/1.1 Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:18:57.326124 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.327772 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': 'd723a853-e49d-405c-9a21-8ce304f65da8'} Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:57.328819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.330286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.331848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:57.331848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-10b1f747-d917-4936-8673-a550b2a6de0e tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 404 len: 111 microversion: 2.1 time: 0.029868 Jul 01 07:18:57.331848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 488/1023] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:18:57 2022] DELETE /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:18:57.335655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:57.336327 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: d723a853-e49d-405c-9a21-8ce304f65da8] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:57.342193 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:57.342641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:57.343419 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:57.343847 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:57.358890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 HTTP/1.1 Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:18:57.360395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.361977 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': 'd723a853-e49d-405c-9a21-8ce304f65da8'} Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:57.365733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. Jul 01 07:18:57.367789 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:57.369644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance d723a853-e49d-405c-9a21-8ce304f65da8 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:57.369644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5623e539-e1fb-4d4e-b14b-213fe508cd76 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8" status: 404 len: 111 microversion: 2.1 time: 0.029895 Jul 01 07:18:57.369644 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 536/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:18:57 2022] GET /compute/v2.1/servers/d723a853-e49d-405c-9a21-8ce304f65da8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 07:18:58.492515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:58.492998 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:58.499382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:58.499811 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:58.500720 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:58.501161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:58.514679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: DELETE /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d HTTP/1.1 Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:18:58.516225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.517785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '587ab81f-e92f-455f-8cc0-09463978813d'} Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:58.518832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.520325 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.521923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:58.521923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c9fc5285-a96e-4559-8602-e602ca4c9e64 tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 404 len: 111 microversion: 2.1 time: 0.028961 Jul 01 07:18:58.521923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 489/1025] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:18:58 2022] DELETE /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:18:58.526523 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:18:58.527153 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] [instance: 587ab81f-e92f-455f-8cc0-09463978813d] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:18:58.533160 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:58.533589 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:58.534338 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:18:58.534790 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:18:58.547820 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] HTTP exception thrown: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Request method failure captured: Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d HTTP/1.1 Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1v33270Xp9S0QraoO-FjnFfUXXIcqSXoSVPlhZpFWsduXs5nPSdPSfhOs08NavsNqafEChOydfmsaG3occI5uU1lFyLQAzDI2DZ9R9b7WkOuyH3Uxz3jU_ELA2ngoQ0vDMQJbZfCzaZTKbrXC1GSbvBxAoSzZO0TybfMCYe1r7Cjk Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:18:58.549280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc0aa7206a704d45a610dccc24ec8767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc0aa7206a704d45a610dccc24ec8767"}]}] Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: dc0aa7206a704d45a610dccc24ec8767 Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1399306379 Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: df44f27783d34370ad83470ffde558a8 Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeNegativeTest-1399306379-project Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.550861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '587ab81f-e92f-455f-8cc0-09463978813d'} Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:18:58.551915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. Jul 01 07:18:58.553343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:18:58.554736 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] Returning 404 to user: Instance 587ab81f-e92f-455f-8cc0-09463978813d could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:18:58.554736 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d4899137-6280-4c2e-aebd-0cd35833167b tempest-AttachVolumeNegativeTest-1399306379 tempest-AttachVolumeNegativeTest-1399306379-project] 10.222.0.48 "GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d" status: 404 len: 111 microversion: 2.1 time: 0.028423 Jul 01 07:18:58.554736 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 537/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:18:58 2022] GET /compute/v2.1/servers/587ab81f-e92f-455f-8cc0-09463978813d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:19:02.755000 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d648a11a-9421-4f98-8c0a-539e6cbe1069 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Action: 'create', calling method: .version_select at 0x7f2c4a462790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1170827270", "metadata": {"Type": "work"}}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:19:03.034378 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d648a11a-9421-4f98-8c0a-539e6cbe1069 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.389317 Jul 01 07:19:03.036203 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 490/1027] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jul 1 07:19:02 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 392 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 07:19:03.047001 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-553950ab-b40b-479d-86b6-b047fc6a5e01 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Calling method '.version_select at 0x7f2c4ec12280>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:03.098607 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-553950ab-b40b-479d-86b6-b047fc6a5e01 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0" status: 200 len: 353 microversion: 2.1 time: 0.055233 Jul 01 07:19:03.099347 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 538/1028] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:19:03 2022] GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:19:04.111803 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e9c8b5b3-b596-4519-a27e-2c6f0e0fd5fc tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Calling method '.version_select at 0x7f2c4a4a48b0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:04.160014 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e9c8b5b3-b596-4519-a27e-2c6f0e0fd5fc tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0" status: 200 len: 354 microversion: 2.1 time: 0.052458 Jul 01 07:19:04.160579 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 491/1029] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:19:04 2022] GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:19:04.172921 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bfde4ae3-8506-4874-a6ff-b4183d4cfb02 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Calling method '.version_select at 0x7f2c4a379c10>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:04.219432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bfde4ae3-8506-4874-a6ff-b4183d4cfb02 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0" status: 200 len: 354 microversion: 2.1 time: 0.051054 Jul 01 07:19:04.219996 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 539/1030] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:19:04 2022] GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:19:04.231879 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2c52fa30-3a07-494f-8819-c40cded9aa5f tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Calling method '.version_select at 0x7f2c4a3028b0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:04.290582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2c52fa30-3a07-494f-8819-c40cded9aa5f tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0" status: 202 len: 0 microversion: 2.1 time: 0.062424 Jul 01 07:19:04.291174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 492/1031] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:19:04 2022] DELETE /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:19:04.299073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-baf97d9c-60f3-4160-80bf-6ba9b27b8ce9 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Calling method '.version_select at 0x7f2c4ec4b160>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:04.347427 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-baf97d9c-60f3-4160-80bf-6ba9b27b8ce9 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0" status: 200 len: 353 microversion: 2.1 time: 0.052108 Jul 01 07:19:04.347995 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 540/1032] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:19:04 2022] GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:19:05.360806 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a7619c71-3258-40bd-8533-d614f331bfc3 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Calling method '.version_select at 0x7f2c4a4ce5e0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:05.387519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-a7619c71-3258-40bd-8533-d614f331bfc3 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] HTTP exception thrown: Volume 9cb6202f-d325-403e-ae16-6349c9946aa0 could not be found. Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a7619c71-3258-40bd-8533-d614f331bfc3 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Request method failure captured: Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0 HTTP/1.1 Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp_m0cyjEXitp7EN74foSKeqRC6SnLM8DnTpiU5qoUUPbt0o7pDKRG7tzawiRXJ7kcN209UaA1LknO_QRABDQktFfE-TBGScBoH7VWqN1qi-haYXb75TXD9jN228FQbNhr2iliAW5LJoJ0fVYmrbqS6FynrHvDnpXSCxZViZppF2d_4 Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: b5eec6aba3d04b44a8e57bc796f0d7df Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-VolumesGetTestJSON-875110212 Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:19:05.389446 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b5eec6aba3d04b44a8e57bc796f0d7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b5eec6aba3d04b44a8e57bc796f0d7df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b5eec6aba3d04b44a8e57bc796f0d7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b5eec6aba3d04b44a8e57bc796f0d7df"}]}] Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-VolumesGetTestJSON-875110212 Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: b5eec6aba3d04b44a8e57bc796f0d7df Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-VolumesGetTestJSON-875110212 Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-VolumesGetTestJSON-875110212-project Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 36ec45f5a2b94747aea686d365575513 Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-VolumesGetTestJSON-875110212-project Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Volume 9cb6202f-d325-403e-ae16-6349c9946aa0 could not be found. Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '9cb6202f-d325-403e-ae16-6349c9946aa0'} Jul 01 07:19:05.391138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9cb6202f-d325-403e-ae16-6349c9946aa0 could not be found. (HTTP 404) (Request-ID: req-75906307-ae5d-4d0a-a3ef-b7556162df40) Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:05.392229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:19:05.393799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9cb6202f-d325-403e-ae16-6349c9946aa0 could not be found. Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 07:19:05.395269 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9cb6202f-d325-403e-ae16-6349c9946aa0 could not be found. Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9cb6202f-d325-403e-ae16-6349c9946aa0 could not be found. Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a7619c71-3258-40bd-8533-d614f331bfc3 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] Returning 404 to user: Volume 9cb6202f-d325-403e-ae16-6349c9946aa0 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a7619c71-3258-40bd-8533-d614f331bfc3 tempest-VolumesGetTestJSON-875110212 tempest-VolumesGetTestJSON-875110212-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0" status: 404 len: 109 microversion: 2.1 time: 0.034403 Jul 01 07:19:05.396734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 493/1033] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:19:05 2022] GET /compute/v2.1/os-volumes/9cb6202f-d325-403e-ae16-6349c9946aa0 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:19:06.716805 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aa46f071-c95e-47e1-8582-e7d9515ba0eb tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Action: 'create', calling method: .version_select at 0x7f2c4a338ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1107637689", "metadata": {"Type": "work"}}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aa46f071-c95e-47e1-8582-e7d9515ba0eb tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Request method failure captured: Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 122 Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp_qdelNb1XL_uPyds0wUu88MjbnkwoRslkT9kVG9mE8fH1_p1LMOgrtf4iVaGGpviynq0YDs-iSLgngqH_1TNWpJb0b7rg3ylY7wmIA3h730ydDs9B340lu3ufLIx9mLUR7CzCGTBpzRiDNw67EHvEAKAVlBtk4AyNnm17nY5y9roM Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:19:06.739870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6cc1b75d801748ac8fb3cda7ce2f461c"}]}] Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 0b885644c1ac4a8cad3c2eb61928ea98 Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1107637689", "metadata": {"Type": "work"}}} Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: Jul 01 07:19:06.742106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1107637689', 'metadata': {'Type': 'work'}}}} Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise error Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi '#$%' Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:06.743152 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 07:19:06.744576 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 07:19:06.746083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 07:19:06.746083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.746083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-aa46f071-c95e-47e1-8582-e7d9515ba0eb tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:06.746083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-aa46f071-c95e-47e1-8582-e7d9515ba0eb tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136966 Jul 01 07:19:06.746083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 541/1034] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jul 1 07:19:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:19:06.752042 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f26cade9-4a87-47f4-9008-10fe14c16d20 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Action: 'create', calling method: .version_select at 0x7f2c4a4a4a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-782169254", "metadata": {"Type": "work"}}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f26cade9-4a87-47f4-9008-10fe14c16d20 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Request method failure captured: Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 119 Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp_qdelNb1XL_uPyds0wUu88MjbnkwoRslkT9kVG9mE8fH1_p1LMOgrtf4iVaGGpviynq0YDs-iSLgngqH_1TNWpJb0b7rg3ylY7wmIA3h730ydDs9B340lu3ufLIx9mLUR7CzCGTBpzRiDNw67EHvEAKAVlBtk4AyNnm17nY5y9roM Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:19:06.755955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6cc1b75d801748ac8fb3cda7ce2f461c"}]}] Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 0b885644c1ac4a8cad3c2eb61928ea98 Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-782169254", "metadata": {"Type": "work"}}} Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: Jul 01 07:19:06.757678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-782169254', 'metadata': {'Type': 'work'}}}} Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise error Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi '0' Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:06.759017 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 07:19:06.760654 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 07:19:06.762194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 07:19:06.762194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.762194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f26cade9-4a87-47f4-9008-10fe14c16d20 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:06.762194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f26cade9-4a87-47f4-9008-10fe14c16d20 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009723 Jul 01 07:19:06.762194 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 494/1035] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jul 1 07:19:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:19:06.765898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a3199611-8bae-4d47-b331-8a7f1fff6278 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Action: 'create', calling method: .version_select at 0x7f2c4ec40550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1976564040", "metadata": {"Type": "work"}}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a3199611-8bae-4d47-b331-8a7f1fff6278 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Request method failure captured: Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 119 Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp_qdelNb1XL_uPyds0wUu88MjbnkwoRslkT9kVG9mE8fH1_p1LMOgrtf4iVaGGpviynq0YDs-iSLgngqH_1TNWpJb0b7rg3ylY7wmIA3h730ydDs9B340lu3ufLIx9mLUR7CzCGTBpzRiDNw67EHvEAKAVlBtk4AyNnm17nY5y9roM Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:19:06.768235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6cc1b75d801748ac8fb3cda7ce2f461c"}]}] Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 0b885644c1ac4a8cad3c2eb61928ea98 Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1976564040", "metadata": {"Type": "work"}}} Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: Jul 01 07:19:06.769907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1976564040', 'metadata': {'Type': 'work'}}}} Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise error Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi '' Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:06.771092 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 07:19:06.772740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 07:19:06.774294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 07:19:06.774294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.774294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a3199611-8bae-4d47-b331-8a7f1fff6278 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:06.774294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a3199611-8bae-4d47-b331-8a7f1fff6278 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007263 Jul 01 07:19:06.774294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 542/1036] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jul 1 07:19:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:19:06.777816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3a3e6975-c43f-4d91-9853-0c5223de284d tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Calling method '.version_select at 0x7f2c4a302d30>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:06.805443 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-3a3e6975-c43f-4d91-9853-0c5223de284d tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] HTTP exception thrown: Volume tempest-invalid-1832617980 could not be found. Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3a3e6975-c43f-4d91-9853-0c5223de284d tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Request method failure captured: Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1832617980 HTTP/1.1 Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp_qdelNb1XL_uPyds0wUu88MjbnkwoRslkT9kVG9mE8fH1_p1LMOgrtf4iVaGGpviynq0YDs-iSLgngqH_1TNWpJb0b7rg3ylY7wmIA3h730ydDs9B340lu3ufLIx9mLUR7CzCGTBpzRiDNw67EHvEAKAVlBtk4AyNnm17nY5y9roM Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:19:06.807401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6cc1b75d801748ac8fb3cda7ce2f461c"}]}] Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 0b885644c1ac4a8cad3c2eb61928ea98 Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Volume tempest-invalid-1832617980 could not be found. Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': 'tempest-invalid-1832617980'} Jul 01 07:19:06.809328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1832617980 could not be found. (HTTP 404) (Request-ID: req-ee6984ed-067d-45d5-b449-40626bfe0de0) Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.810398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 07:19:06.811832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1832617980 could not be found. Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:06.813201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1832617980 could not be found. Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1832617980 could not be found. Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3a3e6975-c43f-4d91-9853-0c5223de284d tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Returning 404 to user: Volume tempest-invalid-1832617980 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3a3e6975-c43f-4d91-9853-0c5223de284d tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1832617980" status: 404 len: 99 microversion: 2.1 time: 0.034423 Jul 01 07:19:06.814679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 495/1037] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jul 1 07:19:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1832617980 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 07:19:06.818913 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1117fb0e-2be7-4de3-af0a-4ad336d1ee9d tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004381 Jul 01 07:19:06.819405 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 543/1038] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jul 1 07:19:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 07:19:06.827888 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c2896595-011b-4767-9ed9-ef60fc8024b9 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004236 Jul 01 07:19:06.828381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 496/1039] 10.222.0.48 () {58 vars in 1136 bytes} [Fri Jul 1 07:19:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 07:19:06.836388 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ef0b84dc-f58b-46f9-9c9b-ddf402d708c9 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Calling method '.version_select at 0x7f2c4a3d8c10>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:06.863882 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-ef0b84dc-f58b-46f9-9c9b-ddf402d708c9 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] HTTP exception thrown: Volume 133d0eb5-01e5-4c93-bcc9-e774eef3a53a could not be found. Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ef0b84dc-f58b-46f9-9c9b-ddf402d708c9 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Request method failure captured: Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: DELETE /compute/v2.1/os-volumes/133d0eb5-01e5-4c93-bcc9-e774eef3a53a HTTP/1.1 Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp_qdelNb1XL_uPyds0wUu88MjbnkwoRslkT9kVG9mE8fH1_p1LMOgrtf4iVaGGpviynq0YDs-iSLgngqH_1TNWpJb0b7rg3ylY7wmIA3h730ydDs9B340lu3ufLIx9mLUR7CzCGTBpzRiDNw67EHvEAKAVlBtk4AyNnm17nY5y9roM Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:19:06.866509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6cc1b75d801748ac8fb3cda7ce2f461c"}]}] Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 0b885644c1ac4a8cad3c2eb61928ea98 Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Volume 133d0eb5-01e5-4c93-bcc9-e774eef3a53a could not be found. Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '133d0eb5-01e5-4c93-bcc9-e774eef3a53a'} Jul 01 07:19:06.868115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 133d0eb5-01e5-4c93-bcc9-e774eef3a53a could not be found. (HTTP 404) (Request-ID: req-cb6d7be8-1486-41c7-a651-2b20c7c75e34) Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.869082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 07:19:06.870588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 133d0eb5-01e5-4c93-bcc9-e774eef3a53a could not be found. Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 07:19:06.871997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 133d0eb5-01e5-4c93-bcc9-e774eef3a53a could not be found. Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 133d0eb5-01e5-4c93-bcc9-e774eef3a53a could not be found. Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ef0b84dc-f58b-46f9-9c9b-ddf402d708c9 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Returning 404 to user: Volume 133d0eb5-01e5-4c93-bcc9-e774eef3a53a could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ef0b84dc-f58b-46f9-9c9b-ddf402d708c9 tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/133d0eb5-01e5-4c93-bcc9-e774eef3a53a" status: 404 len: 109 microversion: 2.1 time: 0.035015 Jul 01 07:19:06.873400 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 544/1040] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:19:06 2022] DELETE /compute/v2.1/os-volumes/133d0eb5-01e5-4c93-bcc9-e774eef3a53a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:19:06.877410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-dcd0104e-be38-42f1-9c48-98b067574d8c tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Calling method '.version_select at 0x7f2c4a4a48b0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:06.904257 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-dcd0104e-be38-42f1-9c48-98b067574d8c tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] HTTP exception thrown: Volume 0ded0ee9-df16-463b-9b01-c6fa59796002 could not be found. Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-dcd0104e-be38-42f1-9c48-98b067574d8c tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Request method failure captured: Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/os-volumes/0ded0ee9-df16-463b-9b01-c6fa59796002 HTTP/1.1 Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp_qdelNb1XL_uPyds0wUu88MjbnkwoRslkT9kVG9mE8fH1_p1LMOgrtf4iVaGGpviynq0YDs-iSLgngqH_1TNWpJb0b7rg3ylY7wmIA3h730ydDs9B340lu3ufLIx9mLUR7CzCGTBpzRiDNw67EHvEAKAVlBtk4AyNnm17nY5y9roM Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:19:06.906207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6cc1b75d801748ac8fb3cda7ce2f461c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6cc1b75d801748ac8fb3cda7ce2f461c"}]}] Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 6cc1b75d801748ac8fb3cda7ce2f461c Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-VolumesNegativeTest-1504848824 Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 0b885644c1ac4a8cad3c2eb61928ea98 Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-VolumesNegativeTest-1504848824-project Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Volume 0ded0ee9-df16-463b-9b01-c6fa59796002 could not be found. Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '0ded0ee9-df16-463b-9b01-c6fa59796002'} Jul 01 07:19:06.907818 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ded0ee9-df16-463b-9b01-c6fa59796002 could not be found. (HTTP 404) (Request-ID: req-b096c1aa-5130-46d3-b62b-1ca2cd859b81) Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.908802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 07:19:06.910192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ded0ee9-df16-463b-9b01-c6fa59796002 could not be found. Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 07:19:06.911494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ded0ee9-df16-463b-9b01-c6fa59796002 could not be found. Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ded0ee9-df16-463b-9b01-c6fa59796002 could not be found. Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-dcd0104e-be38-42f1-9c48-98b067574d8c tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] Returning 404 to user: Volume 0ded0ee9-df16-463b-9b01-c6fa59796002 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-dcd0104e-be38-42f1-9c48-98b067574d8c tempest-VolumesNegativeTest-1504848824 tempest-VolumesNegativeTest-1504848824-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0ded0ee9-df16-463b-9b01-c6fa59796002" status: 404 len: 109 microversion: 2.1 time: 0.034007 Jul 01 07:19:06.913422 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 497/1041] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:19:06 2022] GET /compute/v2.1/os-volumes/0ded0ee9-df16-463b-9b01-c6fa59796002 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:19:43.974065 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:19:43.974835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:19:43.979863 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9206d4ea-d032-4af0-b696-3e2959a607e0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:43.980785 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9206d4ea-d032-4af0-b696-3e2959a607e0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:43.988818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9206d4ea-d032-4af0-b696-3e2959a607e0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:43.989365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9206d4ea-d032-4af0-b696-3e2959a607e0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:43.990161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9206d4ea-d032-4af0-b696-3e2959a607e0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:43.990634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9206d4ea-d032-4af0-b696-3e2959a607e0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:44.020677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9206d4ea-d032-4af0-b696-3e2959a607e0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047901 Jul 01 07:19:44.021218 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 545/1042] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jul 1 07:19:43 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:19:44.077837 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=17 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:19:44.078682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=51 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:19:44.083232 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d77cb0f9-d3fe-4dea-88b5-be739cd88e9a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:44.083879 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d77cb0f9-d3fe-4dea-88b5-be739cd88e9a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:44.092164 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d77cb0f9-d3fe-4dea-88b5-be739cd88e9a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:44.092751 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d77cb0f9-d3fe-4dea-88b5-be739cd88e9a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:44.093527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d77cb0f9-d3fe-4dea-88b5-be739cd88e9a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:44.093966 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d77cb0f9-d3fe-4dea-88b5-be739cd88e9a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:44.119176 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d77cb0f9-d3fe-4dea-88b5-be739cd88e9a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:19:44.196788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d77cb0f9-d3fe-4dea-88b5-be739cd88e9a tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 204 len: 0 microversion: 2.20 time: 0.120308 Jul 01 07:19:44.197549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 498/1043] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jul 1 07:19:44 2022] DELETE /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 07:19:44.205716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:44.206330 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:44.215192 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:44.215784 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:44.216785 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:44.217354 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:44.360234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:44.369230 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:44.370836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:44.372054 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-4b6a1189-1254-473a-988f-88b8adf34110 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.170267 Jul 01 07:19:44.372684 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 546/1044] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:19:44 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:19:45.390998 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:45.391698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:45.398044 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:45.398491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:45.399280 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:45.399715 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:45.529285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:45.538225 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:45.539757 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:45.540945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-fa5a9770-e009-4e78-909d-6a4906983842 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1724 microversion: 2.20 time: 0.154242 Jul 01 07:19:45.541527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 499/1045] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:19:45 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:19:46.560056 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:46.560447 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:46.566677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:46.567153 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:46.567944 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:46.568351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:46.924792 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:46.936858 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:46.938530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e8bf7bbabc4432fa88002ea5c1dce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aec4ac096f4f30b7c357db043925fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:19:46.939753 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ce74d65b-8e10-452b-8cb0-0695bb80cf99 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 200 len: 1656 microversion: 2.20 time: 0.384587 Jul 01 07:19:46.950786 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 547/1046] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:19:46 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 1656 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 07:19:47.312951 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-279f405e-0745-4140-99ca-2b303eedccc8 req-4b67cd41-199d-46bb-be3d-cb7d10dead0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cecf2b-81c9-42be-9f7c-a2b9c74f1d76", "name": "network-vif-deleted", "tag": "124d2096-5c39-4eaf-8073-f7d321f44142"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:19:47.321972 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-279f405e-0745-4140-99ca-2b303eedccc8 req-4b67cd41-199d-46bb-be3d-cb7d10dead0e service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:47.322425 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-279f405e-0745-4140-99ca-2b303eedccc8 req-4b67cd41-199d-46bb-be3d-cb7d10dead0e service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:47.335485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-279f405e-0745-4140-99ca-2b303eedccc8 req-4b67cd41-199d-46bb-be3d-cb7d10dead0e service nova] Creating event network-vif-deleted:124d2096-5c39-4eaf-8073-f7d321f44142 for instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 on hv-cinder-80721 Jul 01 07:19:47.340294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-279f405e-0745-4140-99ca-2b303eedccc8 req-4b67cd41-199d-46bb-be3d-cb7d10dead0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201253 Jul 01 07:19:47.341257 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 500/1047] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:19:47.960482 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:47.961740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:47.974033 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:47.974928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:47.976017 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:47.976596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:47.992358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] HTTP exception thrown: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Request method failure captured: Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 HTTP/1.1 Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1vK-w0YMEyJsFXUO1s85nj7nnRcaGqzm0Xa-RasQui0144tsAa5fcQtghHVia03_ETFtHGl8E5WFYbE5kzx0UvNXTweh_3hNdGyQnwLrIZNxhVrIStRYvjCj1segX5f5LbBqwM1nmzBeg-qCq5Wpb6JdXFtUH2-dZeqz7ljaN7duM Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:19:47.993896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c0aec4ac096f4f30b7c357db043925fd"}]}] Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 0e8bf7bbabc4432fa88002ea5c1dce4c Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:47.995735 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '90cecf2b-81c9-42be-9f7c-a2b9c74f1d76'} Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:47.996643 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:47.998610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:48.001418 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Returning 404 to user: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:48.002033 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-673ec976-6182-441c-b6e5-ac8145a8f6a0 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 404 len: 111 microversion: 2.20 time: 0.048390 Jul 01 07:19:48.002747 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 548/1048] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:19:47 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:19:48.012456 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-52ff637c-fbc2-4f9e-b0ae-0ed3517202df tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '.version_select at 0x7f2c4a6a7c10>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:48.031980 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-52ff637c-fbc2-4f9e-b0ae-0ed3517202df tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752442586" status: 204 len: 0 microversion: 2.20 time: 0.023864 Jul 01 07:19:48.032563 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 501/1049] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Jul 1 07:19:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752442586 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 07:19:49.945923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:49.946446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:49.952975 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:49.953431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:49.954203 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:49.954640 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:49.968828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] HTTP exception thrown: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Request method failure captured: Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: DELETE /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 HTTP/1.1 Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1vK-w0YMEyJsFXUO1s85nj7nnRcaGqzm0Xa-RasQui0144tsAa5fcQtghHVia03_ETFtHGl8E5WFYbE5kzx0UvNXTweh_3hNdGyQnwLrIZNxhVrIStRYvjCj1segX5f5LbBqwM1nmzBeg-qCq5Wpb6JdXFtUH2-dZeqz7ljaN7duM Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:19:49.970318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c0aec4ac096f4f30b7c357db043925fd"}]}] Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 0e8bf7bbabc4432fa88002ea5c1dce4c Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:49.972084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '90cecf2b-81c9-42be-9f7c-a2b9c74f1d76'} Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:49.972888 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:49.974567 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:49.976876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Returning 404 to user: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:49.976876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ddff9679-0878-4353-8682-84055bb3bf83 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 404 len: 111 microversion: 2.20 time: 0.030283 Jul 01 07:19:49.976876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 549/1050] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jul 1 07:19:49 2022] DELETE /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:19:49.980630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:49.981357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:49.987558 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:49.988006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:49.988767 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:49.989195 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:50.002845 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] HTTP exception thrown: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Request method failure captured: Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 HTTP/1.1 Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1vK-w0YMEyJsFXUO1s85nj7nnRcaGqzm0Xa-RasQui0144tsAa5fcQtghHVia03_ETFtHGl8E5WFYbE5kzx0UvNXTweh_3hNdGyQnwLrIZNxhVrIStRYvjCj1segX5f5LbBqwM1nmzBeg-qCq5Wpb6JdXFtUH2-dZeqz7ljaN7duM Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:19:50.004464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c0aec4ac096f4f30b7c357db043925fd"}]}] Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 0e8bf7bbabc4432fa88002ea5c1dce4c Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:50.006244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '90cecf2b-81c9-42be-9f7c-a2b9c74f1d76'} Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:50.007826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. Jul 01 07:19:50.009411 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:50.010989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Returning 404 to user: Instance 90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:50.010989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8681403c-00cb-49ec-9a63-beca51ce1567 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76" status: 404 len: 111 microversion: 2.20 time: 0.029729 Jul 01 07:19:50.010989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 502/1051] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:19:49 2022] GET /compute/v2.1/servers/90cecf2b-81c9-42be-9f7c-a2b9c74f1d76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 07:19:51.143705 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:51.144284 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:51.151309 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:51.151762 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:51.152529 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:51.152968 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:51.166112 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] HTTP exception thrown: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Request method failure captured: Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: DELETE /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 HTTP/1.1 Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivp1vK-w0YMEyJsFXUO1s85nj7nnRcaGqzm0Xa-RasQui0144tsAa5fcQtghHVia03_ETFtHGl8E5WFYbE5kzx0UvNXTweh_3hNdGyQnwLrIZNxhVrIStRYvjCj1segX5f5LbBqwM1nmzBeg-qCq5Wpb6JdXFtUH2-dZeqz7ljaN7duM Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:19:51.167673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c0aec4ac096f4f30b7c357db043925fd"}]}] Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 0e8bf7bbabc4432fa88002ea5c1dce4c Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.169387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '06e3db32-ed35-4c27-ad2f-30bfbe556c25'} Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:51.170314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.171842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.173306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Returning 404 to user: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:51.173306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-25245377-cd1d-4319-a6a5-569ada963cfc tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "DELETE /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 404 len: 111 microversion: 2.20 time: 0.029228 Jul 01 07:19:51.173306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 550/1052] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jul 1 07:19:51 2022] DELETE /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:19:51.177522 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:19:51.178138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] [instance: 06e3db32-ed35-4c27-ad2f-30bfbe556c25] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:19:51.184888 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:51.185342 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:51.186105 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:19:51.186544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:19:51.200983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] HTTP exception thrown: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Request method failure captured: Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 HTTP/1.1 Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivp1vK-w0YMEyJsFXUO1s85nj7nnRcaGqzm0Xa-RasQui0144tsAa5fcQtghHVia03_ETFtHGl8E5WFYbE5kzx0UvNXTweh_3hNdGyQnwLrIZNxhVrIStRYvjCj1segX5f5LbBqwM1nmzBeg-qCq5Wpb6JdXFtUH2-dZeqz7ljaN7duM Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:19:51.202576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c0aec4ac096f4f30b7c357db043925fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c0aec4ac096f4f30b7c357db043925fd"}]}] Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: c0aec4ac096f4f30b7c357db043925fd Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-674075631 Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 0e8bf7bbabc4432fa88002ea5c1dce4c Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-674075631-project Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.204379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '06e3db32-ed35-4c27-ad2f-30bfbe556c25'} Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:19:51.205181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. Jul 01 07:19:51.206398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:19:51.207688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] Returning 404 to user: Instance 06e3db32-ed35-4c27-ad2f-30bfbe556c25 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:19:51.207688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c2fbad4a-e89b-4092-b5aa-f0f5b48f9bc2 tempest-AttachVolumeShelveTestJSON-674075631 tempest-AttachVolumeShelveTestJSON-674075631-project] 10.222.0.48 "GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25" status: 404 len: 111 microversion: 2.20 time: 0.030363 Jul 01 07:19:51.207688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 503/1053] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jul 1 07:19:51 2022] GET /compute/v2.1/servers/06e3db32-ed35-4c27-ad2f-30bfbe556c25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 07:19:59.811926 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e5b533a5-0d16-4895-87c4-099f95bf4cec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'create', calling method: .version_select at 0x7f2c4ec18ee0>, body: {"keypair": {"name": "tempest-keypair-1552851344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoS+tA34Dpq6lzhDyMbs6BX9X7fm76CaaqjeyzjCGxRjDTO3IVDffOa2z6b2/veAk1nxIGU2KEacIPx6aHzBR71o6WCDZ6SFuKPU7l+LUU82PD3ZEtrm5K4ZnHqFkhYPw=="}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:19:59.827275 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-e5b533a5-0d16-4895-87c4-099f95bf4cec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Getting quotas for project a1c0ce09b9e34dd1a5dcce0a3e37fe31. Resources: {'key_pairs'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:19:59.831947 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-e5b533a5-0d16-4895-87c4-099f95bf4cec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Getting quotas for user a8b26629e86b43dfaacc4de87a26ebd4 and project a1c0ce09b9e34dd1a5dcce0a3e37fe31. Resources: {'key_pairs'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:19:59.859003 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e5b533a5-0d16-4895-87c4-099f95bf4cec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194128 Jul 01 07:19:59.859874 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 551/1054] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:19:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:20:01.157644 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-239498865", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "661d307f-1323-40a7-9223-92b058b10c1b"}], "security_groups": [{"name": "tempest-securitygroup--1682599954"}], "key_name": "tempest-keypair-1552851344", "user_data": "}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:20:01.193032 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:01.276061 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] validate_networks() for [('661d307f-1323-40a7-9223-92b058b10c1b', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:20:01.689371 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:20:01.689792 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:20:01.690364 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:20:01.690864 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:20:01.691369 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:20:01.702389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:01.702868 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:01.703717 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:01.704267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:01.723355 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Getting quotas for project a1c0ce09b9e34dd1a5dcce0a3e37fe31. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:20:01.728545 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Getting quotas for user a8b26629e86b43dfaacc4de87a26ebd4 and project a1c0ce09b9e34dd1a5dcce0a3e37fe31. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:20:01.742381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:20:01.744939 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:20:01.800919 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-53ed006e-e134-42d4-a5d2-d5184ceeaa78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647509 Jul 01 07:20:01.802451 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 504/1055] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:20:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:20:01.811187 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=24 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:01.815920 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d55737e4-5963-4910-b57a-5c5be7900744 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:01.816556 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d55737e4-5963-4910-b57a-5c5be7900744 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:01.884059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d55737e4-5963-4910-b57a-5c5be7900744 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:01.890875 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d55737e4-5963-4910-b57a-5c5be7900744 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1237 microversion: 2.1 time: 0.080844 Jul 01 07:20:01.891455 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 552/1056] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:01 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:02.908813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-51e28d38-4ee0-478d-866a-f98cd5e8adbb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:02.909428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-51e28d38-4ee0-478d-866a-f98cd5e8adbb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:02.965006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-51e28d38-4ee0-478d-866a-f98cd5e8adbb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:02.975917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-51e28d38-4ee0-478d-866a-f98cd5e8adbb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1237 microversion: 2.1 time: 0.071470 Jul 01 07:20:02.977207 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 505/1057] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:02 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:03.994926 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a580fc2e-a44e-40d3-8a90-3d7f26c89851 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:03.996401 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a580fc2e-a44e-40d3-8a90-3d7f26c89851 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:04.051744 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a580fc2e-a44e-40d3-8a90-3d7f26c89851 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:04.058900 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a580fc2e-a44e-40d3-8a90-3d7f26c89851 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1237 microversion: 2.1 time: 0.068859 Jul 01 07:20:04.059696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 553/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:03 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:05.076690 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-af5f72ba-1ea4-4dfb-9292-fec58f7dcaf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:05.077351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-af5f72ba-1ea4-4dfb-9292-fec58f7dcaf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:05.134313 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-af5f72ba-1ea4-4dfb-9292-fec58f7dcaf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:05.141299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-af5f72ba-1ea4-4dfb-9292-fec58f7dcaf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1237 microversion: 2.1 time: 0.069443 Jul 01 07:20:05.141866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 506/1059] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:05 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:06.157681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c3b7ed65-2f5d-4fd5-aaab-046288dbbf94 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:06.158473 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c3b7ed65-2f5d-4fd5-aaab-046288dbbf94 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:06.166711 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c3b7ed65-2f5d-4fd5-aaab-046288dbbf94 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:06.166711 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c3b7ed65-2f5d-4fd5-aaab-046288dbbf94 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:06.168546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c3b7ed65-2f5d-4fd5-aaab-046288dbbf94 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:06.168923 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c3b7ed65-2f5d-4fd5-aaab-046288dbbf94 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:06.232938 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c3b7ed65-2f5d-4fd5-aaab-046288dbbf94 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:06.240388 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c3b7ed65-2f5d-4fd5-aaab-046288dbbf94 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1241 microversion: 2.1 time: 0.086489 Jul 01 07:20:06.241811 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 554/1060] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:06 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:07.258216 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-41ffe41b-283f-49b6-b8c8-d7bab5c7dffd tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:07.258862 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-41ffe41b-283f-49b6-b8c8-d7bab5c7dffd tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:07.265773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41ffe41b-283f-49b6-b8c8-d7bab5c7dffd tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:07.266229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41ffe41b-283f-49b6-b8c8-d7bab5c7dffd tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:07.267038 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41ffe41b-283f-49b6-b8c8-d7bab5c7dffd tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:07.267484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-41ffe41b-283f-49b6-b8c8-d7bab5c7dffd tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:07.360575 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-41ffe41b-283f-49b6-b8c8-d7bab5c7dffd tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:07.368220 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-41ffe41b-283f-49b6-b8c8-d7bab5c7dffd tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1295 microversion: 2.1 time: 0.114207 Jul 01 07:20:07.374196 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 507/1061] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:07 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1295 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:08.391580 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-eb1d1f75-8ccf-437d-b402-44b81465e429 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:08.392337 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-eb1d1f75-8ccf-437d-b402-44b81465e429 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:08.399222 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eb1d1f75-8ccf-437d-b402-44b81465e429 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:08.399937 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eb1d1f75-8ccf-437d-b402-44b81465e429 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:08.400729 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eb1d1f75-8ccf-437d-b402-44b81465e429 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:08.401350 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-eb1d1f75-8ccf-437d-b402-44b81465e429 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:08.588006 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-c44ab792-53a6-4418-adf4-d33bc2fca63f req-462ece5d-a3b8-4f87-bcb7-c5637cdd1aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9423db7b-518f-4627-aa50-6db6c04d7ec4", "tag": "55a41909-d2fa-4e56-8a2b-958da47c831a"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:20:08.600793 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-c44ab792-53a6-4418-adf4-d33bc2fca63f req-462ece5d-a3b8-4f87-bcb7-c5637cdd1aa6 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:08.602413 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-c44ab792-53a6-4418-adf4-d33bc2fca63f req-462ece5d-a3b8-4f87-bcb7-c5637cdd1aa6 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:08.618897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-c44ab792-53a6-4418-adf4-d33bc2fca63f req-462ece5d-a3b8-4f87-bcb7-c5637cdd1aa6 service nova] Creating event network-changed:55a41909-d2fa-4e56-8a2b-958da47c831a for instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 on hv-cinder-80721 Jul 01 07:20:08.624399 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-eb1d1f75-8ccf-437d-b402-44b81465e429 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:08.633743 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-eb1d1f75-8ccf-437d-b402-44b81465e429 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1363 microversion: 2.1 time: 0.245769 Jul 01 07:20:08.634664 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 555/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:08 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:08.636814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-c44ab792-53a6-4418-adf4-d33bc2fca63f req-462ece5d-a3b8-4f87-bcb7-c5637cdd1aa6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058711 Jul 01 07:20:08.637537 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 508/1063] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:20:09.653351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d863db3a-d4b6-4ba4-b15c-944cd826daf2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:09.653994 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d863db3a-d4b6-4ba4-b15c-944cd826daf2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:09.661562 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d863db3a-d4b6-4ba4-b15c-944cd826daf2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:09.662014 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d863db3a-d4b6-4ba4-b15c-944cd826daf2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:09.662813 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d863db3a-d4b6-4ba4-b15c-944cd826daf2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:09.663250 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d863db3a-d4b6-4ba4-b15c-944cd826daf2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:09.794361 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d863db3a-d4b6-4ba4-b15c-944cd826daf2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:09.801730 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d863db3a-d4b6-4ba4-b15c-944cd826daf2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1363 microversion: 2.1 time: 0.152423 Jul 01 07:20:09.802298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 556/1064] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:09 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:10.819689 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c7c60b80-0c3e-4661-b220-d4c9bb0106df tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:10.820418 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c7c60b80-0c3e-4661-b220-d4c9bb0106df tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:10.826551 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c7c60b80-0c3e-4661-b220-d4c9bb0106df tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:10.827040 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c7c60b80-0c3e-4661-b220-d4c9bb0106df tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:10.827798 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c7c60b80-0c3e-4661-b220-d4c9bb0106df tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:10.828240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c7c60b80-0c3e-4661-b220-d4c9bb0106df tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:10.957741 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c7c60b80-0c3e-4661-b220-d4c9bb0106df tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:10.965771 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c7c60b80-0c3e-4661-b220-d4c9bb0106df tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1363 microversion: 2.1 time: 0.150812 Jul 01 07:20:10.966364 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 509/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:10 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:11.982117 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-34a03873-fd05-4829-b68d-4cd1e3e63222 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:11.982707 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-34a03873-fd05-4829-b68d-4cd1e3e63222 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:11.989182 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-34a03873-fd05-4829-b68d-4cd1e3e63222 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:11.989625 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-34a03873-fd05-4829-b68d-4cd1e3e63222 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:11.990376 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-34a03873-fd05-4829-b68d-4cd1e3e63222 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:11.990832 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-34a03873-fd05-4829-b68d-4cd1e3e63222 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:12.119404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-34a03873-fd05-4829-b68d-4cd1e3e63222 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:12.127437 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-34a03873-fd05-4829-b68d-4cd1e3e63222 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1363 microversion: 2.1 time: 0.149162 Jul 01 07:20:12.128000 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 557/1066] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:11 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:13.144488 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-0e627c48-37f8-40e7-b614-144b13c7edd7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:13.145104 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-0e627c48-37f8-40e7-b614-144b13c7edd7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:13.147079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:13.153547 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0e627c48-37f8-40e7-b614-144b13c7edd7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:13.154009 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0e627c48-37f8-40e7-b614-144b13c7edd7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:13.154807 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0e627c48-37f8-40e7-b614-144b13c7edd7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:13.155242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-0e627c48-37f8-40e7-b614-144b13c7edd7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:13.287214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-0e627c48-37f8-40e7-b614-144b13c7edd7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:13.295233 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-0e627c48-37f8-40e7-b614-144b13c7edd7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1363 microversion: 2.1 time: 0.154654 Jul 01 07:20:13.295795 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 510/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:13 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:14.311959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f141625f-898c-495c-b8d3-1da7a64e2f6d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:14.312570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f141625f-898c-495c-b8d3-1da7a64e2f6d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:14.314872 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=8 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:14.315519 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:14.322122 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f141625f-898c-495c-b8d3-1da7a64e2f6d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:14.322571 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f141625f-898c-495c-b8d3-1da7a64e2f6d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:14.323365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f141625f-898c-495c-b8d3-1da7a64e2f6d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:14.323804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f141625f-898c-495c-b8d3-1da7a64e2f6d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:14.459616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f141625f-898c-495c-b8d3-1da7a64e2f6d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:14.467438 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f141625f-898c-495c-b8d3-1da7a64e2f6d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1363 microversion: 2.1 time: 0.159614 Jul 01 07:20:14.468019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 558/1068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:14 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:15.107469 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-82305fb7-6ecd-4b09-bec2-95605fa64d7a req-3b1571ef-899f-40c0-951c-21f4197df42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9423db7b-518f-4627-aa50-6db6c04d7ec4", "name": "network-vif-plugged", "status": "completed", "tag": "55a41909-d2fa-4e56-8a2b-958da47c831a"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:20:15.111377 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:15.117947 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-82305fb7-6ecd-4b09-bec2-95605fa64d7a req-3b1571ef-899f-40c0-951c-21f4197df42c service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:15.118388 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-82305fb7-6ecd-4b09-bec2-95605fa64d7a req-3b1571ef-899f-40c0-951c-21f4197df42c service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:15.139643 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=10 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:15.142724 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-82305fb7-6ecd-4b09-bec2-95605fa64d7a req-3b1571ef-899f-40c0-951c-21f4197df42c service nova] Creating event network-vif-plugged:55a41909-d2fa-4e56-8a2b-958da47c831a for instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 on hv-cinder-80721 Jul 01 07:20:15.148543 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-82305fb7-6ecd-4b09-bec2-95605fa64d7a req-3b1571ef-899f-40c0-951c-21f4197df42c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044763 Jul 01 07:20:15.149140 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 511/1069] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:20:15.485760 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-f8b93852-ad4b-46af-9336-5e8f2521d99d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:15.486506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-f8b93852-ad4b-46af-9336-5e8f2521d99d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:15.493884 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8b93852-ad4b-46af-9336-5e8f2521d99d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:15.494428 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8b93852-ad4b-46af-9336-5e8f2521d99d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:15.495314 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8b93852-ad4b-46af-9336-5e8f2521d99d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:15.495860 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-f8b93852-ad4b-46af-9336-5e8f2521d99d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:15.755983 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-f8b93852-ad4b-46af-9336-5e8f2521d99d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:15.763857 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-f8b93852-ad4b-46af-9336-5e8f2521d99d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1363 microversion: 2.1 time: 0.282742 Jul 01 07:20:15.764432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 559/1070] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:15 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:16.782605 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f048247f-f2a2-4d3f-8ea7-9127b7763ce9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:16.783326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f048247f-f2a2-4d3f-8ea7-9127b7763ce9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:16.790035 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f048247f-f2a2-4d3f-8ea7-9127b7763ce9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:16.790484 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f048247f-f2a2-4d3f-8ea7-9127b7763ce9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:16.791270 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f048247f-f2a2-4d3f-8ea7-9127b7763ce9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:16.791707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f048247f-f2a2-4d3f-8ea7-9127b7763ce9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:16.923928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f048247f-f2a2-4d3f-8ea7-9127b7763ce9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:16.932548 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f048247f-f2a2-4d3f-8ea7-9127b7763ce9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1363 microversion: 2.1 time: 0.155659 Jul 01 07:20:16.933368 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 512/1071] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:16 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:17.950093 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-79965670-6176-4e5f-a249-7948713b5ebf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:17.950724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-79965670-6176-4e5f-a249-7948713b5ebf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:17.957154 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-79965670-6176-4e5f-a249-7948713b5ebf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:17.957599 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-79965670-6176-4e5f-a249-7948713b5ebf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:17.958355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-79965670-6176-4e5f-a249-7948713b5ebf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:17.958802 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-79965670-6176-4e5f-a249-7948713b5ebf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:18.086216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-79965670-6176-4e5f-a249-7948713b5ebf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:18.093975 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-79965670-6176-4e5f-a249-7948713b5ebf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1550 microversion: 2.1 time: 0.147756 Jul 01 07:20:18.094537 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 560/1072] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:17 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:18.110455 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d6215efb-b761-49b8-b349-6c7544b49b71 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:18.110989 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d6215efb-b761-49b8-b349-6c7544b49b71 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:18.118161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d6215efb-b761-49b8-b349-6c7544b49b71 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:18.118495 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d6215efb-b761-49b8-b349-6c7544b49b71 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:18.119294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d6215efb-b761-49b8-b349-6c7544b49b71 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:18.119735 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d6215efb-b761-49b8-b349-6c7544b49b71 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:18.197589 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d6215efb-b761-49b8-b349-6c7544b49b71 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091108 Jul 01 07:20:18.198177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 513/1073] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jul 1 07:20:18 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:20:19.076859 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-d16a5cca-2067-4c25-9ec0-98531519785d req-9c114e33-3dc5-4f50-b6ac-4ca7bc360e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9423db7b-518f-4627-aa50-6db6c04d7ec4", "tag": "55a41909-d2fa-4e56-8a2b-958da47c831a"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:20:19.085340 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-d16a5cca-2067-4c25-9ec0-98531519785d req-9c114e33-3dc5-4f50-b6ac-4ca7bc360e37 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:19.085830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-d16a5cca-2067-4c25-9ec0-98531519785d req-9c114e33-3dc5-4f50-b6ac-4ca7bc360e37 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:19.097202 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-d16a5cca-2067-4c25-9ec0-98531519785d req-9c114e33-3dc5-4f50-b6ac-4ca7bc360e37 service nova] Creating event network-changed:55a41909-d2fa-4e56-8a2b-958da47c831a for instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 on hv-cinder-80721 Jul 01 07:20:19.102288 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-d16a5cca-2067-4c25-9ec0-98531519785d req-9c114e33-3dc5-4f50-b6ac-4ca7bc360e37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029076 Jul 01 07:20:19.102901 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 561/1074] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:20:35.089939 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=5 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:35.090677 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=34 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:35.095107 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-515701838", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:20:35.144259 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] validate_networks() for None {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:20:35.418122 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:20:35.418538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:20:35.419034 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:20:35.419440 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:20:35.419847 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:20:35.429803 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:35.430246 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:35.431066 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:35.431500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:35.447678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Getting quotas for project 9b16942a1fe6467989aaaecbd4f178c4. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:20:35.451559 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Getting quotas for user 1cb7a6e99e2b49bba421a7d7c9edabc7 and project 9b16942a1fe6467989aaaecbd4f178c4. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:20:35.462845 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:20:35.465027 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:20:35.508322 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ecf9633c-1045-4b88-a791-53fc23267334 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.419734 Jul 01 07:20:35.508962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 514/1075] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:20:35.516594 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=7 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:35.517690 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=44 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:35.521700 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8a458eba-64b4-4558-b561-ac0d1a1f897d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:35.522432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8a458eba-64b4-4558-b561-ac0d1a1f897d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:35.579105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8a458eba-64b4-4558-b561-ac0d1a1f897d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:35.587712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8a458eba-64b4-4558-b561-ac0d1a1f897d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1214 microversion: 2.1 time: 0.072695 Jul 01 07:20:35.588354 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 562/1076] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:35 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:36.605637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d309b36e-9d57-4f96-b807-fc1c6b025386 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:36.606566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d309b36e-9d57-4f96-b807-fc1c6b025386 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:36.613868 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d309b36e-9d57-4f96-b807-fc1c6b025386 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:36.614570 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d309b36e-9d57-4f96-b807-fc1c6b025386 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:36.615549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d309b36e-9d57-4f96-b807-fc1c6b025386 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:36.616710 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d309b36e-9d57-4f96-b807-fc1c6b025386 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:36.701874 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d309b36e-9d57-4f96-b807-fc1c6b025386 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:36.709834 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d309b36e-9d57-4f96-b807-fc1c6b025386 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1272 microversion: 2.1 time: 0.108940 Jul 01 07:20:36.711322 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 515/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:36 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:37.727681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c9dfbf7b-53f0-4494-8242-b576744e1437 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:37.728441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c9dfbf7b-53f0-4494-8242-b576744e1437 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:37.735421 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c9dfbf7b-53f0-4494-8242-b576744e1437 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:37.735876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c9dfbf7b-53f0-4494-8242-b576744e1437 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:37.736899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c9dfbf7b-53f0-4494-8242-b576744e1437 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:37.738351 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c9dfbf7b-53f0-4494-8242-b576744e1437 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:37.980026 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c9dfbf7b-53f0-4494-8242-b576744e1437 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:37.987606 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c9dfbf7b-53f0-4494-8242-b576744e1437 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.264449 Jul 01 07:20:37.988255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 563/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:37 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:38.413813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-9da86ae7-0b0d-4dd3-ba5b-8f9e200cc1cd req-9440ba1c-376a-491d-8442-e54cacef7b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608a6e14-eabd-4c7f-be0a-989acdc676b1", "tag": "f802fb71-8572-40ac-857c-3907c105b7a8"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:20:38.424990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-9da86ae7-0b0d-4dd3-ba5b-8f9e200cc1cd req-9440ba1c-376a-491d-8442-e54cacef7b1c service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:38.425734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-9da86ae7-0b0d-4dd3-ba5b-8f9e200cc1cd req-9440ba1c-376a-491d-8442-e54cacef7b1c service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:38.438973 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-9da86ae7-0b0d-4dd3-ba5b-8f9e200cc1cd req-9440ba1c-376a-491d-8442-e54cacef7b1c service nova] Creating event network-changed:f802fb71-8572-40ac-857c-3907c105b7a8 for instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 on hv-cinder-80721 Jul 01 07:20:38.444864 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-9da86ae7-0b0d-4dd3-ba5b-8f9e200cc1cd req-9440ba1c-376a-491d-8442-e54cacef7b1c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034746 Jul 01 07:20:38.446174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 516/1079] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:20:39.005075 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c6b8d3ea-4f54-4db4-ba67-4839efcf2a03 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:39.005636 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c6b8d3ea-4f54-4db4-ba67-4839efcf2a03 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:39.012632 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c6b8d3ea-4f54-4db4-ba67-4839efcf2a03 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:39.013083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c6b8d3ea-4f54-4db4-ba67-4839efcf2a03 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:39.013849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c6b8d3ea-4f54-4db4-ba67-4839efcf2a03 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:39.014283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c6b8d3ea-4f54-4db4-ba67-4839efcf2a03 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:39.140802 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c6b8d3ea-4f54-4db4-ba67-4839efcf2a03 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:39.148054 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c6b8d3ea-4f54-4db4-ba67-4839efcf2a03 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.146949 Jul 01 07:20:39.149241 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 564/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:39 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:40.167025 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b818e4f8-d572-411f-bbc3-f87033a22920 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:40.167730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b818e4f8-d572-411f-bbc3-f87033a22920 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:40.173962 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b818e4f8-d572-411f-bbc3-f87033a22920 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:40.174414 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b818e4f8-d572-411f-bbc3-f87033a22920 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:40.175215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b818e4f8-d572-411f-bbc3-f87033a22920 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:40.175656 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b818e4f8-d572-411f-bbc3-f87033a22920 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:40.301728 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b818e4f8-d572-411f-bbc3-f87033a22920 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:40.310883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b818e4f8-d572-411f-bbc3-f87033a22920 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.149159 Jul 01 07:20:40.311474 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 517/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:40 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:41.328572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7bf09c79-3046-4e70-ad4c-dcaa22832a8c tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:41.329194 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7bf09c79-3046-4e70-ad4c-dcaa22832a8c tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:41.335559 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bf09c79-3046-4e70-ad4c-dcaa22832a8c tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:41.336052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bf09c79-3046-4e70-ad4c-dcaa22832a8c tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:41.336828 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bf09c79-3046-4e70-ad4c-dcaa22832a8c tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:41.337308 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7bf09c79-3046-4e70-ad4c-dcaa22832a8c tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:41.494332 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-7bf09c79-3046-4e70-ad4c-dcaa22832a8c tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:41.502187 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7bf09c79-3046-4e70-ad4c-dcaa22832a8c tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.177458 Jul 01 07:20:41.502827 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 565/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:41 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:42.518900 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cef4152f-6d89-4aaf-954c-45b88bfe021d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:42.519437 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cef4152f-6d89-4aaf-954c-45b88bfe021d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:42.525990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cef4152f-6d89-4aaf-954c-45b88bfe021d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:42.526442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cef4152f-6d89-4aaf-954c-45b88bfe021d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:42.527243 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cef4152f-6d89-4aaf-954c-45b88bfe021d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:42.527683 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cef4152f-6d89-4aaf-954c-45b88bfe021d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:42.652633 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cef4152f-6d89-4aaf-954c-45b88bfe021d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:42.660031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cef4152f-6d89-4aaf-954c-45b88bfe021d tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.145062 Jul 01 07:20:42.660584 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 518/1083] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:42 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:20:43.676679 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-36442a20-37e9-404d-a80a-743331968ac9 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:43.677290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-36442a20-37e9-404d-a80a-743331968ac9 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:43.684318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-36442a20-37e9-404d-a80a-743331968ac9 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:43.684767 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-36442a20-37e9-404d-a80a-743331968ac9 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:43.685528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-36442a20-37e9-404d-a80a-743331968ac9 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:43.685964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-36442a20-37e9-404d-a80a-743331968ac9 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:43.820173 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-36442a20-37e9-404d-a80a-743331968ac9 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:43.827626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-36442a20-37e9-404d-a80a-743331968ac9 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.154818 Jul 01 07:20:43.828183 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 566/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:43 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:44.844692 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-64c7934b-9a35-41ba-a465-aae579f893fa tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:44.845303 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-64c7934b-9a35-41ba-a465-aae579f893fa tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:44.851736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-64c7934b-9a35-41ba-a465-aae579f893fa tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:44.852192 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-64c7934b-9a35-41ba-a465-aae579f893fa tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:44.852953 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-64c7934b-9a35-41ba-a465-aae579f893fa tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:44.853389 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-64c7934b-9a35-41ba-a465-aae579f893fa tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:44.982482 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-64c7934b-9a35-41ba-a465-aae579f893fa tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:44.989956 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-64c7934b-9a35-41ba-a465-aae579f893fa tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.149123 Jul 01 07:20:44.990514 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 519/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:44 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:45.387511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-abe63ef3-4a8e-4e1a-800a-b3a29908c3d6 req-1d0fd137-16e9-46f3-ab35-02db582160f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608a6e14-eabd-4c7f-be0a-989acdc676b1", "name": "network-vif-plugged", "status": "completed", "tag": "f802fb71-8572-40ac-857c-3907c105b7a8"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:20:45.395489 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-abe63ef3-4a8e-4e1a-800a-b3a29908c3d6 req-1d0fd137-16e9-46f3-ab35-02db582160f9 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:45.395938 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-abe63ef3-4a8e-4e1a-800a-b3a29908c3d6 req-1d0fd137-16e9-46f3-ab35-02db582160f9 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:45.406436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-abe63ef3-4a8e-4e1a-800a-b3a29908c3d6 req-1d0fd137-16e9-46f3-ab35-02db582160f9 service nova] Creating event network-vif-plugged:f802fb71-8572-40ac-857c-3907c105b7a8 for instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 on hv-cinder-80721 Jul 01 07:20:45.411328 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-abe63ef3-4a8e-4e1a-800a-b3a29908c3d6 req-1d0fd137-16e9-46f3-ab35-02db582160f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151094 Jul 01 07:20:45.411997 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 567/1086] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:20:46.006488 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-47d9d3e3-98cd-45e9-925b-1cb66ede7ec8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:46.007131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-47d9d3e3-98cd-45e9-925b-1cb66ede7ec8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:46.009630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:46.010271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=6 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:46.017007 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-47d9d3e3-98cd-45e9-925b-1cb66ede7ec8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:46.017455 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-47d9d3e3-98cd-45e9-925b-1cb66ede7ec8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:46.018211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-47d9d3e3-98cd-45e9-925b-1cb66ede7ec8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:46.018645 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-47d9d3e3-98cd-45e9-925b-1cb66ede7ec8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:46.145942 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-47d9d3e3-98cd-45e9-925b-1cb66ede7ec8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:46.153288 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-47d9d3e3-98cd-45e9-925b-1cb66ede7ec8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.150627 Jul 01 07:20:46.153844 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 520/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:46 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:47.167104 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:20:47.171876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bde220d7-c620-49fb-93b3-8307967b4205 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:47.172582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bde220d7-c620-49fb-93b3-8307967b4205 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:47.179099 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bde220d7-c620-49fb-93b3-8307967b4205 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:47.179546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bde220d7-c620-49fb-93b3-8307967b4205 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:47.180316 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bde220d7-c620-49fb-93b3-8307967b4205 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:47.180933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bde220d7-c620-49fb-93b3-8307967b4205 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:47.317330 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-bde220d7-c620-49fb-93b3-8307967b4205 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:47.325345 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bde220d7-c620-49fb-93b3-8307967b4205 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1314 microversion: 2.1 time: 0.159275 Jul 01 07:20:47.325912 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 568/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:47 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:48.341839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-616e67b0-6570-483f-b62d-763cfa1550e8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:48.342481 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-616e67b0-6570-483f-b62d-763cfa1550e8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:48.348911 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-616e67b0-6570-483f-b62d-763cfa1550e8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:48.349354 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-616e67b0-6570-483f-b62d-763cfa1550e8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:48.350109 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-616e67b0-6570-483f-b62d-763cfa1550e8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:48.350544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-616e67b0-6570-483f-b62d-763cfa1550e8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:48.481788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-616e67b0-6570-483f-b62d-763cfa1550e8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:48.489113 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-616e67b0-6570-483f-b62d-763cfa1550e8 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1463 microversion: 2.1 time: 0.151134 Jul 01 07:20:48.489671 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 521/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:48 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:48.526691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-50e90197-5d1f-478b-b9ad-222e2f7bafd4 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:48.527239 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-50e90197-5d1f-478b-b9ad-222e2f7bafd4 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:48.533663 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-50e90197-5d1f-478b-b9ad-222e2f7bafd4 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:48.534146 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-50e90197-5d1f-478b-b9ad-222e2f7bafd4 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:48.534941 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-50e90197-5d1f-478b-b9ad-222e2f7bafd4 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:48.535375 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-50e90197-5d1f-478b-b9ad-222e2f7bafd4 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:48.705524 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-50e90197-5d1f-478b-b9ad-222e2f7bafd4 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:20:48.777531 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-50e90197-5d1f-478b-b9ad-222e2f7bafd4 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "DELETE /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 204 len: 0 microversion: 2.1 time: 0.254850 Jul 01 07:20:48.778025 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 569/1090] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:20:48 2022] DELETE /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:20:48.786519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-59032bcc-c3ae-4fab-bc71-4faced06f0cd tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:48.787156 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-59032bcc-c3ae-4fab-bc71-4faced06f0cd tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:48.793390 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-59032bcc-c3ae-4fab-bc71-4faced06f0cd tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:48.793843 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-59032bcc-c3ae-4fab-bc71-4faced06f0cd tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:48.794587 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-59032bcc-c3ae-4fab-bc71-4faced06f0cd tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:48.795048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-59032bcc-c3ae-4fab-bc71-4faced06f0cd tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:48.920311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-59032bcc-c3ae-4fab-bc71-4faced06f0cd tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:48.927660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-59032bcc-c3ae-4fab-bc71-4faced06f0cd tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1469 microversion: 2.1 time: 0.145115 Jul 01 07:20:48.928210 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 522/1091] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:48 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1469 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:20:49.946948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-30abd8fe-9b57-4958-bb0e-266d7b409f29 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:49.947648 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-30abd8fe-9b57-4958-bb0e-266d7b409f29 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:49.954041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-30abd8fe-9b57-4958-bb0e-266d7b409f29 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:49.954494 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-30abd8fe-9b57-4958-bb0e-266d7b409f29 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:49.955290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-30abd8fe-9b57-4958-bb0e-266d7b409f29 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:49.955727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-30abd8fe-9b57-4958-bb0e-266d7b409f29 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:50.085892 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-30abd8fe-9b57-4958-bb0e-266d7b409f29 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:50.094656 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-30abd8fe-9b57-4958-bb0e-266d7b409f29 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1469 microversion: 2.1 time: 0.152491 Jul 01 07:20:50.095258 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 570/1092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:49 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:51.002762 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-3b0c7b57-0769-4367-8271-c395ed240154 req-6512e17e-5772-425c-b4b8-257b4bbcc139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608a6e14-eabd-4c7f-be0a-989acdc676b1", "name": "network-vif-deleted", "tag": "f802fb71-8572-40ac-857c-3907c105b7a8"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:20:51.012503 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-3b0c7b57-0769-4367-8271-c395ed240154 req-6512e17e-5772-425c-b4b8-257b4bbcc139 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:51.012950 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-3b0c7b57-0769-4367-8271-c395ed240154 req-6512e17e-5772-425c-b4b8-257b4bbcc139 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:51.027161 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-3b0c7b57-0769-4367-8271-c395ed240154 req-6512e17e-5772-425c-b4b8-257b4bbcc139 service nova] Creating event network-vif-deleted:f802fb71-8572-40ac-857c-3907c105b7a8 for instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 on hv-cinder-80721 Jul 01 07:20:51.032915 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-3b0c7b57-0769-4367-8271-c395ed240154 req-6512e17e-5772-425c-b4b8-257b4bbcc139 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Jul 01 07:20:51.033927 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 523/1093] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:20:51.112205 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:51.112850 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:51.119580 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:51.120281 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:51.121195 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:51.121491 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:51.153304 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:51.153754 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:51.154233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lazy-loading 'fault' on Instance uuid 608a6e14-eabd-4c7f-be0a-989acdc676b1 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:20:51.197302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7a6e99e2b49bba421a7d7c9edabc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b16942a1fe6467989aaaecbd4f178c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:20:51.204683 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0a86d863-1c1b-4c02-affe-f1f5df529e2e tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 200 len: 1304 microversion: 2.1 time: 0.096455 Jul 01 07:20:51.205237 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 571/1094] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:51 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:20:52.221968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:20:52.222685 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] [instance: 608a6e14-eabd-4c7f-be0a-989acdc676b1] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:20:52.230030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:52.230487 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:52.231298 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:20:52.231744 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:20:52.245003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] HTTP exception thrown: Instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 could not be found. Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Request method failure captured: Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 HTTP/1.1 Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivqBBl7g1pQhKlRAY9Zk40YeupSrEF8WlwgK3Jrd7wt5DUmL437AynGWk9JaHohwKK4lyPdEa7px5PO8wWM5PNmBBpJ48qIlHlPxXq3QChYZFXE5WMsca5flGxG5Ocf-IRQDiUJ42YCdrXvjBKwlrqD_QCVKNB6pif0tj7CaW4olYDaM Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: 9b16942a1fe6467989aaaecbd4f178c4 Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-VolumesNegativeTest-1353141530 Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:20:52.246596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b16942a1fe6467989aaaecbd4f178c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9b16942a1fe6467989aaaecbd4f178c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9b16942a1fe6467989aaaecbd4f178c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9b16942a1fe6467989aaaecbd4f178c4"}]}] Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-VolumesNegativeTest-1353141530 Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: 9b16942a1fe6467989aaaecbd4f178c4 Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-VolumesNegativeTest-1353141530 Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-VolumesNegativeTest-1353141530-project Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 1cb7a6e99e2b49bba421a7d7c9edabc7 Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-VolumesNegativeTest-1353141530-project Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 could not be found. Jul 01 07:20:52.248206 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '608a6e14-eabd-4c7f-be0a-989acdc676b1'} Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 could not be found. Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:20:52.249150 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 could not be found. Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 could not be found. Jul 01 07:20:52.250824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:20:52.252349 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] Returning 404 to user: Instance 608a6e14-eabd-4c7f-be0a-989acdc676b1 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:20:52.252349 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7dc6924e-5c5d-4f83-a748-606d3b069804 tempest-VolumesNegativeTest-1353141530 tempest-VolumesNegativeTest-1353141530-project] 10.222.0.48 "GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1" status: 404 len: 111 microversion: 2.1 time: 0.030236 Jul 01 07:20:52.252349 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 524/1095] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:20:52 2022] GET /compute/v2.1/servers/608a6e14-eabd-4c7f-be0a-989acdc676b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:21:23.694240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bf5a757a-41fa-4715-89e9-6bc7999b0759 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:23.694754 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bf5a757a-41fa-4715-89e9-6bc7999b0759 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:23.696871 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:21:23.697515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:21:23.703390 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf5a757a-41fa-4715-89e9-6bc7999b0759 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:23.703835 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf5a757a-41fa-4715-89e9-6bc7999b0759 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:23.704595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf5a757a-41fa-4715-89e9-6bc7999b0759 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:23.705027 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf5a757a-41fa-4715-89e9-6bc7999b0759 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:23.727958 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bf5a757a-41fa-4715-89e9-6bc7999b0759 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/ips" status: 200 len: 147 microversion: 2.1 time: 0.038321 Jul 01 07:21:23.728493 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 572/1096] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:21:23 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:21:27.523725 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-347d4ade-2f99-42e2-a12a-4c251594c834 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fc4825b-6f85-43fe-b1bc-7eb422bebdee"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:21:27.524785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-347d4ade-2f99-42e2-a12a-4c251594c834 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:27.526934 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:21:27.527572 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=50 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:21:27.533379 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-347d4ade-2f99-42e2-a12a-4c251594c834 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:27.533832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-347d4ade-2f99-42e2-a12a-4c251594c834 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:27.534592 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-347d4ade-2f99-42e2-a12a-4c251594c834 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:27.535073 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-347d4ade-2f99-42e2-a12a-4c251594c834 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:27.785241 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-347d4ade-2f99-42e2-a12a-4c251594c834 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265387 Jul 01 07:21:27.786022 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 525/1097] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:21:27 2022] POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:21:35.274368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5935f94a-2602-4e78-b041-e881288b180a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:21:35.276910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:21:35.277542 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=4 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:21:35.283013 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5935f94a-2602-4e78-b041-e881288b180a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:35.283464 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5935f94a-2602-4e78-b041-e881288b180a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:35.344550 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5935f94a-2602-4e78-b041-e881288b180a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Going to try to stop instance {{(pid=117835) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 07:21:35.386718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5935f94a-2602-4e78-b041-e881288b180a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.116004 Jul 01 07:21:35.387654 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 573/1098] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:21:35 2022] POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:21:35.397054 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-8af9b4d5-64ca-421e-97d2-3540c9db9a6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:35.397752 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-8af9b4d5-64ca-421e-97d2-3540c9db9a6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:35.405106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8af9b4d5-64ca-421e-97d2-3540c9db9a6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:35.406075 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8af9b4d5-64ca-421e-97d2-3540c9db9a6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:35.407084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8af9b4d5-64ca-421e-97d2-3540c9db9a6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:35.407736 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-8af9b4d5-64ca-421e-97d2-3540c9db9a6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:35.542683 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-8af9b4d5-64ca-421e-97d2-3540c9db9a6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:35.550655 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-8af9b4d5-64ca-421e-97d2-3540c9db9a6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.157863 Jul 01 07:21:35.551256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 526/1099] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:35 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:36.568819 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0be81752-3365-41ee-9b19-26f1b0fe2543 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:36.569439 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0be81752-3365-41ee-9b19-26f1b0fe2543 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:36.575698 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0be81752-3365-41ee-9b19-26f1b0fe2543 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:36.576142 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0be81752-3365-41ee-9b19-26f1b0fe2543 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:36.576898 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0be81752-3365-41ee-9b19-26f1b0fe2543 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:36.577329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0be81752-3365-41ee-9b19-26f1b0fe2543 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:36.701733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0be81752-3365-41ee-9b19-26f1b0fe2543 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:36.709551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0be81752-3365-41ee-9b19-26f1b0fe2543 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.145178 Jul 01 07:21:36.710106 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 574/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:36 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:37.726510 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bc786471-b233-4ed5-a799-1dd57363f7eb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:37.727143 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bc786471-b233-4ed5-a799-1dd57363f7eb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:37.733678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc786471-b233-4ed5-a799-1dd57363f7eb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:37.734123 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc786471-b233-4ed5-a799-1dd57363f7eb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:37.734909 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc786471-b233-4ed5-a799-1dd57363f7eb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:37.735341 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bc786471-b233-4ed5-a799-1dd57363f7eb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:37.860886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bc786471-b233-4ed5-a799-1dd57363f7eb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:37.872458 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bc786471-b233-4ed5-a799-1dd57363f7eb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.149755 Jul 01 07:21:37.872955 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 527/1101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:37 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:38.891245 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8ae15309-0f78-4fc8-afbd-a59b0713a9ba tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:38.891924 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8ae15309-0f78-4fc8-afbd-a59b0713a9ba tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:38.899602 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ae15309-0f78-4fc8-afbd-a59b0713a9ba tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:38.900048 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ae15309-0f78-4fc8-afbd-a59b0713a9ba tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:38.900812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ae15309-0f78-4fc8-afbd-a59b0713a9ba tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:38.901241 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8ae15309-0f78-4fc8-afbd-a59b0713a9ba tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:39.028618 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8ae15309-0f78-4fc8-afbd-a59b0713a9ba tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:39.036393 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8ae15309-0f78-4fc8-afbd-a59b0713a9ba tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.149129 Jul 01 07:21:39.036950 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 575/1102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:38 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:40.053861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-954c049f-2fb4-4f05-9f95-b385acb6c1f0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:40.054410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-954c049f-2fb4-4f05-9f95-b385acb6c1f0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:40.061173 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-954c049f-2fb4-4f05-9f95-b385acb6c1f0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:40.061618 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-954c049f-2fb4-4f05-9f95-b385acb6c1f0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:40.062370 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-954c049f-2fb4-4f05-9f95-b385acb6c1f0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:40.062827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-954c049f-2fb4-4f05-9f95-b385acb6c1f0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:40.187410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-954c049f-2fb4-4f05-9f95-b385acb6c1f0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:40.195967 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-954c049f-2fb4-4f05-9f95-b385acb6c1f0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.146577 Jul 01 07:21:40.196526 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 528/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:40 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:41.213186 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-48f4ef07-731a-49d6-b430-53d386184e6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:41.213804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-48f4ef07-731a-49d6-b430-53d386184e6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:41.220302 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-48f4ef07-731a-49d6-b430-53d386184e6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:41.220756 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-48f4ef07-731a-49d6-b430-53d386184e6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:41.221518 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-48f4ef07-731a-49d6-b430-53d386184e6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:41.221983 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-48f4ef07-731a-49d6-b430-53d386184e6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:41.349843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-48f4ef07-731a-49d6-b430-53d386184e6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:41.357873 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-48f4ef07-731a-49d6-b430-53d386184e6a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.149158 Jul 01 07:21:41.358448 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 576/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:41 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:42.374847 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f2932fb8-941f-4fdf-b74e-31b7933f2b74 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:42.375485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f2932fb8-941f-4fdf-b74e-31b7933f2b74 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:42.382538 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f2932fb8-941f-4fdf-b74e-31b7933f2b74 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:42.383022 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f2932fb8-941f-4fdf-b74e-31b7933f2b74 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:42.383790 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f2932fb8-941f-4fdf-b74e-31b7933f2b74 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:42.384230 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f2932fb8-941f-4fdf-b74e-31b7933f2b74 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:42.508935 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f2932fb8-941f-4fdf-b74e-31b7933f2b74 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:42.516789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f2932fb8-941f-4fdf-b74e-31b7933f2b74 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.145855 Jul 01 07:21:42.517341 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 529/1105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:42 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:43.533618 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6badb0d9-6576-4f19-88a4-d481cb8e1c11 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:43.534149 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6badb0d9-6576-4f19-88a4-d481cb8e1c11 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:43.540584 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6badb0d9-6576-4f19-88a4-d481cb8e1c11 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:43.541028 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6badb0d9-6576-4f19-88a4-d481cb8e1c11 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:43.541785 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6badb0d9-6576-4f19-88a4-d481cb8e1c11 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:43.542217 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6badb0d9-6576-4f19-88a4-d481cb8e1c11 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:43.669812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6badb0d9-6576-4f19-88a4-d481cb8e1c11 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:43.678277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6badb0d9-6576-4f19-88a4-d481cb8e1c11 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.148140 Jul 01 07:21:43.678868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 577/1106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:43 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:44.696062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b076845f-83d4-4c1d-b9b5-68a5b1446e7c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:44.697657 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b076845f-83d4-4c1d-b9b5-68a5b1446e7c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:44.703030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b076845f-83d4-4c1d-b9b5-68a5b1446e7c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:44.703481 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b076845f-83d4-4c1d-b9b5-68a5b1446e7c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:44.704235 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b076845f-83d4-4c1d-b9b5-68a5b1446e7c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:44.704669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b076845f-83d4-4c1d-b9b5-68a5b1446e7c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:44.828459 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b076845f-83d4-4c1d-b9b5-68a5b1446e7c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:44.836249 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b076845f-83d4-4c1d-b9b5-68a5b1446e7c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.144637 Jul 01 07:21:44.836798 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 530/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:44 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:45.852877 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0b3eabb9-b1d7-4a2e-af62-463c9a24224f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:45.853492 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0b3eabb9-b1d7-4a2e-af62-463c9a24224f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:45.860157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0b3eabb9-b1d7-4a2e-af62-463c9a24224f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:45.860605 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0b3eabb9-b1d7-4a2e-af62-463c9a24224f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:45.861365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0b3eabb9-b1d7-4a2e-af62-463c9a24224f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:45.861800 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0b3eabb9-b1d7-4a2e-af62-463c9a24224f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:45.991556 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0b3eabb9-b1d7-4a2e-af62-463c9a24224f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:45.999678 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0b3eabb9-b1d7-4a2e-af62-463c9a24224f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.150645 Jul 01 07:21:46.000240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 578/1108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:45 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:47.017038 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e3d3db7e-c5d3-40a2-9c84-6f9cf802029a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:47.017647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e3d3db7e-c5d3-40a2-9c84-6f9cf802029a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:47.024627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e3d3db7e-c5d3-40a2-9c84-6f9cf802029a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:47.025084 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e3d3db7e-c5d3-40a2-9c84-6f9cf802029a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:47.025844 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e3d3db7e-c5d3-40a2-9c84-6f9cf802029a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:47.026278 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e3d3db7e-c5d3-40a2-9c84-6f9cf802029a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:47.157724 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e3d3db7e-c5d3-40a2-9c84-6f9cf802029a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:47.165549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e3d3db7e-c5d3-40a2-9c84-6f9cf802029a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.152394 Jul 01 07:21:47.166107 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 531/1109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:47 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:48.182128 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ba884b5e-7a42-4109-a51a-7760c4194e50 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:48.183039 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ba884b5e-7a42-4109-a51a-7760c4194e50 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:48.189602 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ba884b5e-7a42-4109-a51a-7760c4194e50 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:48.190053 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ba884b5e-7a42-4109-a51a-7760c4194e50 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:48.190843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ba884b5e-7a42-4109-a51a-7760c4194e50 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:48.191284 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ba884b5e-7a42-4109-a51a-7760c4194e50 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:48.320432 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-ba884b5e-7a42-4109-a51a-7760c4194e50 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:48.328406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ba884b5e-7a42-4109-a51a-7760c4194e50 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.150875 Jul 01 07:21:48.328974 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 579/1110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:48 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:49.345360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c3e485d0-199c-4baf-aa98-2d8eed164989 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:49.345995 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c3e485d0-199c-4baf-aa98-2d8eed164989 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:49.352548 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c3e485d0-199c-4baf-aa98-2d8eed164989 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:49.352990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c3e485d0-199c-4baf-aa98-2d8eed164989 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:49.353738 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c3e485d0-199c-4baf-aa98-2d8eed164989 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:49.354168 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c3e485d0-199c-4baf-aa98-2d8eed164989 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:49.483318 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-c3e485d0-199c-4baf-aa98-2d8eed164989 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:49.491092 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c3e485d0-199c-4baf-aa98-2d8eed164989 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.149584 Jul 01 07:21:49.491650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 532/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:49 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:50.507918 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9624b5d4-05e5-4f9f-8309-900e626147a3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:50.508581 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9624b5d4-05e5-4f9f-8309-900e626147a3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:50.515086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9624b5d4-05e5-4f9f-8309-900e626147a3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:50.515541 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9624b5d4-05e5-4f9f-8309-900e626147a3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:50.516299 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9624b5d4-05e5-4f9f-8309-900e626147a3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:50.516734 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9624b5d4-05e5-4f9f-8309-900e626147a3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:50.644236 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9624b5d4-05e5-4f9f-8309-900e626147a3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:50.652588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9624b5d4-05e5-4f9f-8309-900e626147a3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1725 microversion: 2.1 time: 0.148561 Jul 01 07:21:50.653148 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 580/1112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:50 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:50.824313 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:21:50.824537 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:21:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:21:51.669317 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ea8784e0-0e03-4f31-bc23-622ddff54fe6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:51.669930 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ea8784e0-0e03-4f31-bc23-622ddff54fe6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:51.676326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ea8784e0-0e03-4f31-bc23-622ddff54fe6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:51.676773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ea8784e0-0e03-4f31-bc23-622ddff54fe6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:51.678133 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ea8784e0-0e03-4f31-bc23-622ddff54fe6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:51.678579 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ea8784e0-0e03-4f31-bc23-622ddff54fe6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:51.804810 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ea8784e0-0e03-4f31-bc23-622ddff54fe6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:51.812801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ea8784e0-0e03-4f31-bc23-622ddff54fe6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1702 microversion: 2.1 time: 0.147340 Jul 01 07:21:51.813349 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 533/1113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:51 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1702 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:51.828798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1b648a12-2ab1-4fe0-9362-4557f6a0534e tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:21:51.835346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1b648a12-2ab1-4fe0-9362-4557f6a0534e tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:51.835797 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1b648a12-2ab1-4fe0-9362-4557f6a0534e tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:51.857358 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1b648a12-2ab1-4fe0-9362-4557f6a0534e tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Going to try to start instance {{(pid=117835) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 07:21:51.898313 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1b648a12-2ab1-4fe0-9362-4557f6a0534e tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.073179 Jul 01 07:21:51.899058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 581/1114] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:21:51 2022] POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:21:51.907015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-43c5d9a3-4a9b-4290-9f65-6883edcc361d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:51.907656 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-43c5d9a3-4a9b-4290-9f65-6883edcc361d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:51.914110 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-43c5d9a3-4a9b-4290-9f65-6883edcc361d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:51.914585 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-43c5d9a3-4a9b-4290-9f65-6883edcc361d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:51.915448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-43c5d9a3-4a9b-4290-9f65-6883edcc361d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:51.915960 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-43c5d9a3-4a9b-4290-9f65-6883edcc361d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:52.059902 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-43c5d9a3-4a9b-4290-9f65-6883edcc361d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:52.067848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-43c5d9a3-4a9b-4290-9f65-6883edcc361d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1711 microversion: 2.1 time: 0.164657 Jul 01 07:21:52.068416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 534/1115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:51 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:53.085681 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-22c8821c-83e7-4bde-962b-18f029055889 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:53.086410 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-22c8821c-83e7-4bde-962b-18f029055889 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:53.093074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-22c8821c-83e7-4bde-962b-18f029055889 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:53.093532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-22c8821c-83e7-4bde-962b-18f029055889 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:53.094289 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-22c8821c-83e7-4bde-962b-18f029055889 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:53.094722 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-22c8821c-83e7-4bde-962b-18f029055889 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:53.234204 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-22c8821c-83e7-4bde-962b-18f029055889 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:53.242919 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-22c8821c-83e7-4bde-962b-18f029055889 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1711 microversion: 2.1 time: 0.161477 Jul 01 07:21:53.243468 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 582/1116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:53 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:21:54.260866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cf6545ef-a901-42f6-a97a-b9565576fbac tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:21:54.261543 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cf6545ef-a901-42f6-a97a-b9565576fbac tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:21:54.268130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cf6545ef-a901-42f6-a97a-b9565576fbac tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:54.268588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cf6545ef-a901-42f6-a97a-b9565576fbac tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:54.269360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cf6545ef-a901-42f6-a97a-b9565576fbac tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:21:54.269800 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cf6545ef-a901-42f6-a97a-b9565576fbac tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:21:54.397533 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cf6545ef-a901-42f6-a97a-b9565576fbac tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:21:54.405839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cf6545ef-a901-42f6-a97a-b9565576fbac tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1715 microversion: 2.1 time: 0.148809 Jul 01 07:21:54.406410 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 535/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:21:54 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:22:49.590701 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-285d6f13-b196-4ce5-9a11-d8c7993244e1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:49.591321 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-285d6f13-b196-4ce5-9a11-d8c7993244e1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:49.593226 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=20 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:22:49.593870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:22:49.599428 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-285d6f13-b196-4ce5-9a11-d8c7993244e1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:49.599894 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-285d6f13-b196-4ce5-9a11-d8c7993244e1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:49.600650 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-285d6f13-b196-4ce5-9a11-d8c7993244e1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:49.601081 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-285d6f13-b196-4ce5-9a11-d8c7993244e1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:49.679763 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-285d6f13-b196-4ce5-9a11-d8c7993244e1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lazy-loading 'services' on Instance uuid 9423db7b-518f-4627-aa50-6db6c04d7ec4 {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:22:49.749369 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-285d6f13-b196-4ce5-9a11-d8c7993244e1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/os-volume_attachments/9fc4825b-6f85-43fe-b1bc-7eb422bebdee" status: 202 len: 0 microversion: 2.1 time: 0.162786 Jul 01 07:22:49.749937 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 583/1118] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:22:49 2022] DELETE /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/os-volume_attachments/9fc4825b-6f85-43fe-b1bc-7eb422bebdee => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:22:50.862426 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-76cf6c1b-cb3a-4155-8212-738e94a609ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:22:50.864679 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=22 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:22:50.865381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:22:50.871307 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-76cf6c1b-cb3a-4155-8212-738e94a609ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:50.871756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-76cf6c1b-cb3a-4155-8212-738e94a609ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:50.930929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-76cf6c1b-cb3a-4155-8212-738e94a609ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Going to try to stop instance {{(pid=117836) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 07:22:50.972770 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-76cf6c1b-cb3a-4155-8212-738e94a609ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.114257 Jul 01 07:22:50.973357 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 536/1119] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:22:50 2022] POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 07:22:50.982596 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-74bfd742-7195-4f6d-a627-8ad80c08bcfb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:50.983325 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-74bfd742-7195-4f6d-a627-8ad80c08bcfb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:50.989512 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-74bfd742-7195-4f6d-a627-8ad80c08bcfb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:50.989931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-74bfd742-7195-4f6d-a627-8ad80c08bcfb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:50.990700 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-74bfd742-7195-4f6d-a627-8ad80c08bcfb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:50.991161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-74bfd742-7195-4f6d-a627-8ad80c08bcfb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:51.120078 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-74bfd742-7195-4f6d-a627-8ad80c08bcfb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:22:51.127526 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-74bfd742-7195-4f6d-a627-8ad80c08bcfb tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.149697 Jul 01 07:22:51.128093 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 584/1120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:22:50 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:22:52.147204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-661d181d-03f0-430d-9d39-09be61d15ab1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:52.147903 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-661d181d-03f0-430d-9d39-09be61d15ab1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:52.153987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-661d181d-03f0-430d-9d39-09be61d15ab1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:52.154432 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-661d181d-03f0-430d-9d39-09be61d15ab1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:52.155212 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-661d181d-03f0-430d-9d39-09be61d15ab1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:52.155649 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-661d181d-03f0-430d-9d39-09be61d15ab1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:52.288013 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-661d181d-03f0-430d-9d39-09be61d15ab1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:22:52.295374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-661d181d-03f0-430d-9d39-09be61d15ab1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.153778 Jul 01 07:22:52.295931 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 537/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:22:52 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:22:53.312579 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a7e4f07b-e2a4-4f26-949e-662e791c2a13 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:53.313228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a7e4f07b-e2a4-4f26-949e-662e791c2a13 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:53.319724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a7e4f07b-e2a4-4f26-949e-662e791c2a13 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:53.320176 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a7e4f07b-e2a4-4f26-949e-662e791c2a13 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:53.320950 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a7e4f07b-e2a4-4f26-949e-662e791c2a13 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:53.321411 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a7e4f07b-e2a4-4f26-949e-662e791c2a13 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:53.447955 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a7e4f07b-e2a4-4f26-949e-662e791c2a13 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:22:53.455355 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a7e4f07b-e2a4-4f26-949e-662e791c2a13 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.146649 Jul 01 07:22:53.455907 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 585/1122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:22:53 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:22:54.471817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a200e9f0-299b-48ea-abdc-8472d657a9ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:54.472354 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a200e9f0-299b-48ea-abdc-8472d657a9ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:54.481273 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a200e9f0-299b-48ea-abdc-8472d657a9ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:54.481746 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a200e9f0-299b-48ea-abdc-8472d657a9ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:54.482519 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a200e9f0-299b-48ea-abdc-8472d657a9ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:54.483003 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a200e9f0-299b-48ea-abdc-8472d657a9ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:54.610949 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-a200e9f0-299b-48ea-abdc-8472d657a9ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:22:54.619044 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a200e9f0-299b-48ea-abdc-8472d657a9ec tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.151155 Jul 01 07:22:54.619613 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 538/1123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:22:54 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:22:55.636582 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0f014187-bd44-4fb1-a912-69091f22c2cf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:55.637197 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0f014187-bd44-4fb1-a912-69091f22c2cf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:55.643626 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f014187-bd44-4fb1-a912-69091f22c2cf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:55.644074 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f014187-bd44-4fb1-a912-69091f22c2cf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:55.644836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f014187-bd44-4fb1-a912-69091f22c2cf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:55.645271 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0f014187-bd44-4fb1-a912-69091f22c2cf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:55.768750 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0f014187-bd44-4fb1-a912-69091f22c2cf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:22:55.776102 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0f014187-bd44-4fb1-a912-69091f22c2cf tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.143427 Jul 01 07:22:55.776660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 586/1124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:22:55 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:22:56.792992 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5d97e89d-61de-4118-991d-937dfde248a6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:56.793592 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5d97e89d-61de-4118-991d-937dfde248a6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:56.799961 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5d97e89d-61de-4118-991d-937dfde248a6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:56.800405 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5d97e89d-61de-4118-991d-937dfde248a6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:56.801152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5d97e89d-61de-4118-991d-937dfde248a6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:56.801582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5d97e89d-61de-4118-991d-937dfde248a6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:56.934448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5d97e89d-61de-4118-991d-937dfde248a6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:22:56.941807 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5d97e89d-61de-4118-991d-937dfde248a6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.152706 Jul 01 07:22:56.942362 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 539/1125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:22:56 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:22:57.961569 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e7cfe55a-f833-4957-88b3-d3119504b872 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:57.962128 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e7cfe55a-f833-4957-88b3-d3119504b872 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:57.968840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e7cfe55a-f833-4957-88b3-d3119504b872 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:57.969296 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e7cfe55a-f833-4957-88b3-d3119504b872 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:57.970089 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e7cfe55a-f833-4957-88b3-d3119504b872 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:57.970527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e7cfe55a-f833-4957-88b3-d3119504b872 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:58.096539 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e7cfe55a-f833-4957-88b3-d3119504b872 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:22:58.104599 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e7cfe55a-f833-4957-88b3-d3119504b872 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.147442 Jul 01 07:22:58.105155 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 587/1126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:22:57 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:22:59.121990 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f8351bd9-4ca5-42a7-b7e6-1440c04b2d66 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:22:59.122600 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f8351bd9-4ca5-42a7-b7e6-1440c04b2d66 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:22:59.129005 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f8351bd9-4ca5-42a7-b7e6-1440c04b2d66 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:59.129459 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f8351bd9-4ca5-42a7-b7e6-1440c04b2d66 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:59.130219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f8351bd9-4ca5-42a7-b7e6-1440c04b2d66 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:22:59.130656 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f8351bd9-4ca5-42a7-b7e6-1440c04b2d66 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:22:59.256067 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f8351bd9-4ca5-42a7-b7e6-1440c04b2d66 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:22:59.263491 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f8351bd9-4ca5-42a7-b7e6-1440c04b2d66 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.145397 Jul 01 07:22:59.264051 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 540/1127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:22:59 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:23:00.280252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d642fa6d-8639-466f-9484-b31d1ae0f4c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:23:00.280858 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d642fa6d-8639-466f-9484-b31d1ae0f4c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:23:00.287496 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d642fa6d-8639-466f-9484-b31d1ae0f4c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:00.287926 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d642fa6d-8639-466f-9484-b31d1ae0f4c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:00.288713 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d642fa6d-8639-466f-9484-b31d1ae0f4c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:00.289146 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d642fa6d-8639-466f-9484-b31d1ae0f4c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:00.417277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d642fa6d-8639-466f-9484-b31d1ae0f4c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:23:00.424727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d642fa6d-8639-466f-9484-b31d1ae0f4c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1679 microversion: 2.1 time: 0.148333 Jul 01 07:23:00.425275 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 588/1128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:23:00 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:23:01.442271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4c089f26-2567-40e7-823b-b2c6bdcdfe4f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:23:01.443508 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4c089f26-2567-40e7-823b-b2c6bdcdfe4f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:23:01.450666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c089f26-2567-40e7-823b-b2c6bdcdfe4f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:01.451156 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c089f26-2567-40e7-823b-b2c6bdcdfe4f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:01.451936 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c089f26-2567-40e7-823b-b2c6bdcdfe4f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:01.452376 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4c089f26-2567-40e7-823b-b2c6bdcdfe4f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:01.580293 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4c089f26-2567-40e7-823b-b2c6bdcdfe4f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:23:01.589717 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4c089f26-2567-40e7-823b-b2c6bdcdfe4f tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1656 microversion: 2.1 time: 0.151468 Jul 01 07:23:01.590294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 541/1129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:23:01 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:23:01.605803 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9e8feee2-a4e9-4777-a7ad-cb4eef6724f3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:23:01.612257 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9e8feee2-a4e9-4777-a7ad-cb4eef6724f3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:01.612703 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9e8feee2-a4e9-4777-a7ad-cb4eef6724f3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:01.634669 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9e8feee2-a4e9-4777-a7ad-cb4eef6724f3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Going to try to start instance {{(pid=117835) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 07:23:01.674724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9e8feee2-a4e9-4777-a7ad-cb4eef6724f3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.072629 Jul 01 07:23:01.675352 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 589/1130] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jul 1 07:23:01 2022] POST /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 07:23:01.684971 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-534b97b4-8ab5-4126-9710-5de807a26934 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:23:01.685593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-534b97b4-8ab5-4126-9710-5de807a26934 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:23:01.694478 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-534b97b4-8ab5-4126-9710-5de807a26934 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:01.695593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-534b97b4-8ab5-4126-9710-5de807a26934 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:01.696785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-534b97b4-8ab5-4126-9710-5de807a26934 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:01.697236 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-534b97b4-8ab5-4126-9710-5de807a26934 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:01.875566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-534b97b4-8ab5-4126-9710-5de807a26934 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:23:01.883794 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-534b97b4-8ab5-4126-9710-5de807a26934 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1665 microversion: 2.1 time: 0.203502 Jul 01 07:23:01.884578 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 542/1131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:23:01 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1665 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:23:02.902610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-75ae3a8b-0ee4-48b1-80ee-50cc70e7efe3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:23:02.903356 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-75ae3a8b-0ee4-48b1-80ee-50cc70e7efe3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:23:02.909502 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-75ae3a8b-0ee4-48b1-80ee-50cc70e7efe3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:02.909958 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-75ae3a8b-0ee4-48b1-80ee-50cc70e7efe3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:02.911208 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-75ae3a8b-0ee4-48b1-80ee-50cc70e7efe3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:02.911700 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-75ae3a8b-0ee4-48b1-80ee-50cc70e7efe3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:03.040061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-75ae3a8b-0ee4-48b1-80ee-50cc70e7efe3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:23:03.047470 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-75ae3a8b-0ee4-48b1-80ee-50cc70e7efe3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1669 microversion: 2.1 time: 0.149791 Jul 01 07:23:03.048029 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 590/1132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:23:02 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:23:36.777485 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:23:36.778089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:23:58.666114 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-62e74468-748a-4b38-9ab4-172cbc3426c1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:23:58.667135 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-62e74468-748a-4b38-9ab4-172cbc3426c1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:23:58.669166 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=14 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:23:58.669819 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:23:58.675848 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-62e74468-748a-4b38-9ab4-172cbc3426c1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:58.676326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-62e74468-748a-4b38-9ab4-172cbc3426c1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:58.677091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-62e74468-748a-4b38-9ab4-172cbc3426c1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:58.677525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-62e74468-748a-4b38-9ab4-172cbc3426c1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:58.707031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-62e74468-748a-4b38-9ab4-172cbc3426c1 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044869 Jul 01 07:23:58.708067 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 543/1133] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:23:58 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 07:23:58.763143 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-03919a78-c2ae-4cb3-9eee-7aa0a5f435f6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:23:58.763632 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-03919a78-c2ae-4cb3-9eee-7aa0a5f435f6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:23:58.765933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=16 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:23:58.766809 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:23:58.772634 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-03919a78-c2ae-4cb3-9eee-7aa0a5f435f6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:58.773084 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-03919a78-c2ae-4cb3-9eee-7aa0a5f435f6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:58.773856 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-03919a78-c2ae-4cb3-9eee-7aa0a5f435f6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:58.774343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-03919a78-c2ae-4cb3-9eee-7aa0a5f435f6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:58.799704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-03919a78-c2ae-4cb3-9eee-7aa0a5f435f6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:23:58.875214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-03919a78-c2ae-4cb3-9eee-7aa0a5f435f6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 204 len: 0 microversion: 2.1 time: 0.115499 Jul 01 07:23:58.875709 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 591/1134] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:23:58 2022] DELETE /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:23:58.883977 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3765c628-0951-40af-94f1-3b92c0c61954 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:23:58.884574 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3765c628-0951-40af-94f1-3b92c0c61954 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:23:58.890606 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3765c628-0951-40af-94f1-3b92c0c61954 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:58.891089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3765c628-0951-40af-94f1-3b92c0c61954 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:58.891861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3765c628-0951-40af-94f1-3b92c0c61954 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:23:58.892322 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3765c628-0951-40af-94f1-3b92c0c61954 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:23:59.226323 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3765c628-0951-40af-94f1-3b92c0c61954 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:23:59.233698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3765c628-0951-40af-94f1-3b92c0c61954 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1675 microversion: 2.1 time: 0.353800 Jul 01 07:23:59.234251 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 544/1135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:23:58 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1675 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:24:00.252112 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-082e4e9b-8b78-49b6-be2c-cbe20c4732f2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:00.252814 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-082e4e9b-8b78-49b6-be2c-cbe20c4732f2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:00.259310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-082e4e9b-8b78-49b6-be2c-cbe20c4732f2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:00.259772 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-082e4e9b-8b78-49b6-be2c-cbe20c4732f2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:00.260553 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-082e4e9b-8b78-49b6-be2c-cbe20c4732f2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:00.261000 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-082e4e9b-8b78-49b6-be2c-cbe20c4732f2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:00.439143 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-082e4e9b-8b78-49b6-be2c-cbe20c4732f2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:00.446839 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-082e4e9b-8b78-49b6-be2c-cbe20c4732f2 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1675 microversion: 2.1 time: 0.198881 Jul 01 07:24:00.447406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 592/1136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:00 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:01.463943 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-51ec485a-79ba-49d2-9e8f-56eb175621e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:01.464460 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-51ec485a-79ba-49d2-9e8f-56eb175621e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:01.471119 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-51ec485a-79ba-49d2-9e8f-56eb175621e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:01.471565 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-51ec485a-79ba-49d2-9e8f-56eb175621e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:01.472326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-51ec485a-79ba-49d2-9e8f-56eb175621e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:01.473299 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-51ec485a-79ba-49d2-9e8f-56eb175621e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:01.720261 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-51ec485a-79ba-49d2-9e8f-56eb175621e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:01.728335 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-51ec485a-79ba-49d2-9e8f-56eb175621e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 200 len: 1675 microversion: 2.1 time: 0.268439 Jul 01 07:24:01.728890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 545/1137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:01 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 1675 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:02.177768 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-83cdc4d9-8bc5-4559-b37f-96aff971a553 req-a88ce392-9131-42e0-ad00-18553d3f52dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9423db7b-518f-4627-aa50-6db6c04d7ec4", "name": "network-vif-deleted", "tag": "55a41909-d2fa-4e56-8a2b-958da47c831a"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:24:02.187560 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-83cdc4d9-8bc5-4559-b37f-96aff971a553 req-a88ce392-9131-42e0-ad00-18553d3f52dd service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:02.188001 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-83cdc4d9-8bc5-4559-b37f-96aff971a553 req-a88ce392-9131-42e0-ad00-18553d3f52dd service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:02.200053 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-83cdc4d9-8bc5-4559-b37f-96aff971a553 req-a88ce392-9131-42e0-ad00-18553d3f52dd service nova] Creating event network-vif-deleted:55a41909-d2fa-4e56-8a2b-958da47c831a for instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 on hv-cinder-80721 Jul 01 07:24:02.205413 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-83cdc4d9-8bc5-4559-b37f-96aff971a553 req-a88ce392-9131-42e0-ad00-18553d3f52dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031213 Jul 01 07:24:02.206044 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 593/1138] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:24:02.745802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:02.746517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:02.753131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:02.753696 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:02.754474 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:02.754945 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:02.772891 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] HTTP exception thrown: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Request method failure captured: Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 HTTP/1.1 Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivqAft7BgLU3nJICdIRza5Vu-Syh7FtoRkLI3TNslNLD9f5gl8WdXzRalosSo61-IUGs34kA7Ntvl-A1aNXnJN_8zzatScAqCVpq_KpG9bBwyo1V-wpMc0t7EIUxBBucVIYoeBxW8W6SQM8Ggl1NSv--KQJ_qRYUdBaNEpRH8ZGpw9FE Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:24:02.774669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}] Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: a8b26629e86b43dfaacc4de87a26ebd4 Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:24:02.776493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '9423db7b-518f-4627-aa50-6db6c04d7ec4'} Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:24:02.777404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:24:02.778813 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:24:02.780062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Returning 404 to user: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:24:02.780062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7440906e-4be7-45ce-ab66-e49f8141eed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 404 len: 111 microversion: 2.1 time: 0.034421 Jul 01 07:24:02.780062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 546/1139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:02 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:24:02.787096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b55da4bc-1650-4572-9871-5b6aab0133c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '.version_select at 0x7f2c4ec90430>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:02.805233 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b55da4bc-1650-4572-9871-5b6aab0133c8 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552851344" status: 202 len: 0 microversion: 2.1 time: 0.023003 Jul 01 07:24:02.805818 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 594/1140] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jul 1 07:24:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552851344 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:24:03.475106 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-787a5bb6-8def-4a90-be2f-7b465dd2ed56 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'create', calling method: .version_select at 0x7f2c4a2b9820>, body: {"keypair": {"name": "tempest-keypair-2109685664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK985MIG2fKjVak3lYjoMbGP+FqtPLbVy3AdrX3gJH4ASZoMyCOx6yI6vJW26vkTfE+YZeI3qLhi1K2xABHmBOWAucKcWw9NHEtE/ayANOF8dYs+Mas4H5V+kx5JyVqzkw=="}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:24:03.488622 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-787a5bb6-8def-4a90-be2f-7b465dd2ed56 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Getting quotas for project a1c0ce09b9e34dd1a5dcce0a3e37fe31. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:24:03.492480 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-787a5bb6-8def-4a90-be2f-7b465dd2ed56 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Getting quotas for user a8b26629e86b43dfaacc4de87a26ebd4 and project a1c0ce09b9e34dd1a5dcce0a3e37fe31. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:24:03.513650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-787a5bb6-8def-4a90-be2f-7b465dd2ed56 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043043 Jul 01 07:24:03.514214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 547/1141] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:24:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:24:04.741743 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-895069907", "imageRef": "5e2a68ab-caa9-467e-ad9f-0656280ac3a3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "661d307f-1323-40a7-9223-92b058b10c1b"}], "security_groups": [{"name": "tempest-securitygroup--2047545903"}], "key_name": "tempest-keypair-2109685664", "user_data": "}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:24:04.843676 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] validate_networks() for [('661d307f-1323-40a7-9223-92b058b10c1b', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:24:05.252548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:24:05.252986 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:24:05.253469 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:24:05.254616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:24:05.255078 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:24:05.263834 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:05.264291 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:05.265105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:05.265551 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:05.282475 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Getting quotas for project a1c0ce09b9e34dd1a5dcce0a3e37fe31. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:24:05.286443 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Getting quotas for user a8b26629e86b43dfaacc4de87a26ebd4 and project a1c0ce09b9e34dd1a5dcce0a3e37fe31. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:24:05.297375 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:24:05.299753 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e2a68ab-caa9-467e-ad9f-0656280ac3a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:24:05.346602 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c00309df-ed2f-47de-9fd6-3b7a96484383 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609681 Jul 01 07:24:05.347271 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 595/1142] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:24:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:24:05.357773 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-815aa9c6-1d28-4214-8c69-7cc4f8ca5446 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:05.358384 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-815aa9c6-1d28-4214-8c69-7cc4f8ca5446 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:05.410496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-815aa9c6-1d28-4214-8c69-7cc4f8ca5446 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:05.417117 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-815aa9c6-1d28-4214-8c69-7cc4f8ca5446 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1237 microversion: 2.1 time: 0.063782 Jul 01 07:24:05.417617 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 548/1143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:05 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:06.434214 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5ff56c54-f241-4a85-ae94-090917d4c055 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:06.434948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5ff56c54-f241-4a85-ae94-090917d4c055 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:06.491169 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5ff56c54-f241-4a85-ae94-090917d4c055 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:06.496830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5ff56c54-f241-4a85-ae94-090917d4c055 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1237 microversion: 2.1 time: 0.067408 Jul 01 07:24:06.497387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 596/1144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:06 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:07.513130 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d56b7a0a-d2bd-4744-86b9-304c143d8e78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:07.513816 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d56b7a0a-d2bd-4744-86b9-304c143d8e78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:07.568211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-d56b7a0a-d2bd-4744-86b9-304c143d8e78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:07.575913 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d56b7a0a-d2bd-4744-86b9-304c143d8e78 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1237 microversion: 2.1 time: 0.066606 Jul 01 07:24:07.576472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 549/1145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:07 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:08.592992 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2baa7f6f-02c1-4d0e-a77a-306541f95b76 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:08.593609 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2baa7f6f-02c1-4d0e-a77a-306541f95b76 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:08.648600 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2baa7f6f-02c1-4d0e-a77a-306541f95b76 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:08.655366 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2baa7f6f-02c1-4d0e-a77a-306541f95b76 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1237 microversion: 2.1 time: 0.066249 Jul 01 07:24:08.655934 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 597/1146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:08 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:09.672214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-880f9a3c-7e02-4061-8fed-0f85f682910c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:09.672821 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-880f9a3c-7e02-4061-8fed-0f85f682910c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:09.682556 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-880f9a3c-7e02-4061-8fed-0f85f682910c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:09.682556 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-880f9a3c-7e02-4061-8fed-0f85f682910c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:09.683331 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-880f9a3c-7e02-4061-8fed-0f85f682910c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:09.683767 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-880f9a3c-7e02-4061-8fed-0f85f682910c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:09.742883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-880f9a3c-7e02-4061-8fed-0f85f682910c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:09.750188 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-880f9a3c-7e02-4061-8fed-0f85f682910c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1241 microversion: 2.1 time: 0.081989 Jul 01 07:24:09.750738 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 550/1147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:09 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:10.766564 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1b233425-29a0-46c7-a874-5d1059a77e55 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:10.767155 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1b233425-29a0-46c7-a874-5d1059a77e55 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:10.773991 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1b233425-29a0-46c7-a874-5d1059a77e55 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:10.774448 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1b233425-29a0-46c7-a874-5d1059a77e55 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:10.775251 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1b233425-29a0-46c7-a874-5d1059a77e55 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:10.775861 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1b233425-29a0-46c7-a874-5d1059a77e55 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:10.848999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-1b233425-29a0-46c7-a874-5d1059a77e55 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:10.856619 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1b233425-29a0-46c7-a874-5d1059a77e55 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1295 microversion: 2.1 time: 0.093985 Jul 01 07:24:10.857184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 598/1148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:10 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:11.809645 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-3c5000e7-8bf3-4fac-a2a6-7f72c5205cd2 req-589146ab-ee7d-452d-8572-b8c3b958ce76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98643912-ee1a-41a7-a96b-c740cc8c03ce", "tag": "d67a72c6-fe01-44b2-8397-1c61bcf4bbf8"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:24:11.825476 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-3c5000e7-8bf3-4fac-a2a6-7f72c5205cd2 req-589146ab-ee7d-452d-8572-b8c3b958ce76 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:11.825928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-3c5000e7-8bf3-4fac-a2a6-7f72c5205cd2 req-589146ab-ee7d-452d-8572-b8c3b958ce76 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:11.838873 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-3c5000e7-8bf3-4fac-a2a6-7f72c5205cd2 req-589146ab-ee7d-452d-8572-b8c3b958ce76 service nova] Creating event network-changed:d67a72c6-fe01-44b2-8397-1c61bcf4bbf8 for instance 98643912-ee1a-41a7-a96b-c740cc8c03ce on hv-cinder-80721 Jul 01 07:24:11.843715 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-3c5000e7-8bf3-4fac-a2a6-7f72c5205cd2 req-589146ab-ee7d-452d-8572-b8c3b958ce76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038325 Jul 01 07:24:11.844401 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 551/1149] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:24:11.873892 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-6591e431-2b04-467e-81e1-83e0a9c6aec6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:11.876497 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-6591e431-2b04-467e-81e1-83e0a9c6aec6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:11.884408 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6591e431-2b04-467e-81e1-83e0a9c6aec6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:11.885130 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6591e431-2b04-467e-81e1-83e0a9c6aec6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:11.885931 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6591e431-2b04-467e-81e1-83e0a9c6aec6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:11.886374 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-6591e431-2b04-467e-81e1-83e0a9c6aec6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:12.365047 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-6591e431-2b04-467e-81e1-83e0a9c6aec6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:12.372575 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-6591e431-2b04-467e-81e1-83e0a9c6aec6 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1363 microversion: 2.1 time: 0.502890 Jul 01 07:24:12.373139 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 599/1150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:11 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1363 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:13.391076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-eaf76467-bfff-4dbe-b18e-408a823026b7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:13.391779 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-eaf76467-bfff-4dbe-b18e-408a823026b7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:13.398560 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eaf76467-bfff-4dbe-b18e-408a823026b7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:13.399042 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eaf76467-bfff-4dbe-b18e-408a823026b7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:13.399805 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eaf76467-bfff-4dbe-b18e-408a823026b7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:13.400243 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-eaf76467-bfff-4dbe-b18e-408a823026b7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:13.530660 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-eaf76467-bfff-4dbe-b18e-408a823026b7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:13.538169 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-eaf76467-bfff-4dbe-b18e-408a823026b7 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1363 microversion: 2.1 time: 0.151776 Jul 01 07:24:13.538738 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 552/1151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:13 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:14.555366 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b6850a56-869a-44c2-b549-14aa97cd7297 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:14.555981 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b6850a56-869a-44c2-b549-14aa97cd7297 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:14.562759 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b6850a56-869a-44c2-b549-14aa97cd7297 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:14.563235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b6850a56-869a-44c2-b549-14aa97cd7297 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:14.564007 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b6850a56-869a-44c2-b549-14aa97cd7297 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:14.564441 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b6850a56-869a-44c2-b549-14aa97cd7297 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:14.777126 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b6850a56-869a-44c2-b549-14aa97cd7297 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:14.784427 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b6850a56-869a-44c2-b549-14aa97cd7297 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1363 microversion: 2.1 time: 0.232942 Jul 01 07:24:14.785511 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 600/1152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:14 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:15.801339 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-f8acfa3a-6272-4375-a65b-7f97b850f6e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:15.801950 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-f8acfa3a-6272-4375-a65b-7f97b850f6e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:15.808742 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f8acfa3a-6272-4375-a65b-7f97b850f6e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:15.809188 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f8acfa3a-6272-4375-a65b-7f97b850f6e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:15.809946 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f8acfa3a-6272-4375-a65b-7f97b850f6e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:15.810382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-f8acfa3a-6272-4375-a65b-7f97b850f6e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:15.939349 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-f8acfa3a-6272-4375-a65b-7f97b850f6e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:15.947279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-f8acfa3a-6272-4375-a65b-7f97b850f6e3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1363 microversion: 2.1 time: 0.149793 Jul 01 07:24:15.947836 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 553/1153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:15 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:16.963870 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-43f25aea-3a3a-40f3-bdb0-ef13f955f541 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:16.964606 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-43f25aea-3a3a-40f3-bdb0-ef13f955f541 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:16.966666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:24:16.973609 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43f25aea-3a3a-40f3-bdb0-ef13f955f541 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:16.974051 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43f25aea-3a3a-40f3-bdb0-ef13f955f541 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:16.974929 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43f25aea-3a3a-40f3-bdb0-ef13f955f541 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:16.975364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-43f25aea-3a3a-40f3-bdb0-ef13f955f541 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:17.103999 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-43f25aea-3a3a-40f3-bdb0-ef13f955f541 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:17.111207 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-43f25aea-3a3a-40f3-bdb0-ef13f955f541 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1363 microversion: 2.1 time: 0.151182 Jul 01 07:24:17.111771 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 601/1154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:16 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:24:18.127753 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-63563f06-a86e-43cf-8df4-ab2a26d188c0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:18.128426 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-63563f06-a86e-43cf-8df4-ab2a26d188c0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:18.130883 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=8 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:24:18.136324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-63563f06-a86e-43cf-8df4-ab2a26d188c0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:18.136780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-63563f06-a86e-43cf-8df4-ab2a26d188c0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:18.137544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-63563f06-a86e-43cf-8df4-ab2a26d188c0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:18.138010 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-63563f06-a86e-43cf-8df4-ab2a26d188c0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:18.264917 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-63563f06-a86e-43cf-8df4-ab2a26d188c0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:18.272844 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-63563f06-a86e-43cf-8df4-ab2a26d188c0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1363 microversion: 2.1 time: 0.148938 Jul 01 07:24:18.273399 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 554/1155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:18 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:18.450469 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-5f59fdc9-f1c5-450d-a266-63a32dd97cce req-d1894ef3-fc02-4017-bf80-70c0ab10f3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98643912-ee1a-41a7-a96b-c740cc8c03ce", "name": "network-vif-plugged", "status": "completed", "tag": "d67a72c6-fe01-44b2-8397-1c61bcf4bbf8"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:24:18.460211 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-5f59fdc9-f1c5-450d-a266-63a32dd97cce req-d1894ef3-fc02-4017-bf80-70c0ab10f3a8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:18.460656 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-5f59fdc9-f1c5-450d-a266-63a32dd97cce req-d1894ef3-fc02-4017-bf80-70c0ab10f3a8 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:18.472082 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-5f59fdc9-f1c5-450d-a266-63a32dd97cce req-d1894ef3-fc02-4017-bf80-70c0ab10f3a8 service nova] Creating event network-vif-plugged:d67a72c6-fe01-44b2-8397-1c61bcf4bbf8 for instance 98643912-ee1a-41a7-a96b-c740cc8c03ce on hv-cinder-80721 Jul 01 07:24:18.477736 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-5f59fdc9-f1c5-450d-a266-63a32dd97cce req-d1894ef3-fc02-4017-bf80-70c0ab10f3a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030973 Jul 01 07:24:18.478502 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 602/1156] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:24:19.289567 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-37da35a3-234d-48df-847c-1029d1bb7950 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:19.290176 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-37da35a3-234d-48df-847c-1029d1bb7950 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:19.296579 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-37da35a3-234d-48df-847c-1029d1bb7950 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:19.297032 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-37da35a3-234d-48df-847c-1029d1bb7950 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:19.297789 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-37da35a3-234d-48df-847c-1029d1bb7950 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:19.298222 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-37da35a3-234d-48df-847c-1029d1bb7950 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:19.432094 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-37da35a3-234d-48df-847c-1029d1bb7950 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:19.439416 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-37da35a3-234d-48df-847c-1029d1bb7950 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1363 microversion: 2.1 time: 0.153731 Jul 01 07:24:19.439973 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 555/1157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:19 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:24:20.454105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=10 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:24:20.459294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3b94b855-b28e-4437-ae2d-c33dc037b4e4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:20.459990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3b94b855-b28e-4437-ae2d-c33dc037b4e4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:20.466431 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3b94b855-b28e-4437-ae2d-c33dc037b4e4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:20.466915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3b94b855-b28e-4437-ae2d-c33dc037b4e4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:20.467817 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3b94b855-b28e-4437-ae2d-c33dc037b4e4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:20.468738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3b94b855-b28e-4437-ae2d-c33dc037b4e4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:20.600829 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3b94b855-b28e-4437-ae2d-c33dc037b4e4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:24:20.608269 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3b94b855-b28e-4437-ae2d-c33dc037b4e4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1549 microversion: 2.1 time: 0.155389 Jul 01 07:24:20.608830 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 603/1158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:24:20 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:24:20.624787 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d53a9491-1a85-45e7-b638-c99e88b59a2d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:24:20.625287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d53a9491-1a85-45e7-b638-c99e88b59a2d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:24:20.632258 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d53a9491-1a85-45e7-b638-c99e88b59a2d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:20.632702 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d53a9491-1a85-45e7-b638-c99e88b59a2d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:20.633454 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d53a9491-1a85-45e7-b638-c99e88b59a2d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:20.633886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d53a9491-1a85-45e7-b638-c99e88b59a2d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:20.708138 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d53a9491-1a85-45e7-b638-c99e88b59a2d tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087179 Jul 01 07:24:20.708730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 556/1159] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jul 1 07:24:20 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:24:21.609383 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-36751fb9-2d45-41c3-ab37-a4d6f930b2cd req-dd4ddd49-c55e-4c92-b46c-9753a3d6ae60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98643912-ee1a-41a7-a96b-c740cc8c03ce", "tag": "d67a72c6-fe01-44b2-8397-1c61bcf4bbf8"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:24:21.617825 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-36751fb9-2d45-41c3-ab37-a4d6f930b2cd req-dd4ddd49-c55e-4c92-b46c-9753a3d6ae60 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:24:21.618268 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-36751fb9-2d45-41c3-ab37-a4d6f930b2cd req-dd4ddd49-c55e-4c92-b46c-9753a3d6ae60 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:24:21.629687 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-36751fb9-2d45-41c3-ab37-a4d6f930b2cd req-dd4ddd49-c55e-4c92-b46c-9753a3d6ae60 service nova] Creating event network-changed:d67a72c6-fe01-44b2-8397-1c61bcf4bbf8 for instance 98643912-ee1a-41a7-a96b-c740cc8c03ce on hv-cinder-80721 Jul 01 07:24:21.634597 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-36751fb9-2d45-41c3-ab37-a4d6f930b2cd req-dd4ddd49-c55e-4c92-b46c-9753a3d6ae60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028989 Jul 01 07:24:21.635221 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 604/1160] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:37.023923 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:25:37.024667 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=56 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:25:37.085154 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9caae9d4-1dcb-4691-b5c7-c6aee10d7a48 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:37.085644 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9caae9d4-1dcb-4691-b5c7-c6aee10d7a48 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:37.091633 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9caae9d4-1dcb-4691-b5c7-c6aee10d7a48 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:37.092077 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9caae9d4-1dcb-4691-b5c7-c6aee10d7a48 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:37.092825 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9caae9d4-1dcb-4691-b5c7-c6aee10d7a48 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:37.093250 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9caae9d4-1dcb-4691-b5c7-c6aee10d7a48 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:37.118727 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9caae9d4-1dcb-4691-b5c7-c6aee10d7a48 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/ips" status: 200 len: 146 microversion: 2.1 time: 0.096838 Jul 01 07:25:37.119287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 557/1161] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jul 1 07:25:37 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/ips => generated 146 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:38.429157 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:25:38.429891 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:25:38.434641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-583bc745-9a3a-401c-9f3c-6138c37efa77 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a001c06-5dad-4bc1-8220-908d3bf27769"}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:25:38.435799 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-583bc745-9a3a-401c-9f3c-6138c37efa77 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:38.443630 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-583bc745-9a3a-401c-9f3c-6138c37efa77 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:38.444086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-583bc745-9a3a-401c-9f3c-6138c37efa77 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:38.444857 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-583bc745-9a3a-401c-9f3c-6138c37efa77 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:38.445290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-583bc745-9a3a-401c-9f3c-6138c37efa77 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:38.690723 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-583bc745-9a3a-401c-9f3c-6138c37efa77 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264040 Jul 01 07:25:38.691350 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 605/1162] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:25:38 2022] POST /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:46.163687 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2aa6d0f8-a828-4d80-b67c-a81db7c0c163 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:46.164666 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2aa6d0f8-a828-4d80-b67c-a81db7c0c163 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:46.171071 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2aa6d0f8-a828-4d80-b67c-a81db7c0c163 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:46.171527 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2aa6d0f8-a828-4d80-b67c-a81db7c0c163 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:46.172287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2aa6d0f8-a828-4d80-b67c-a81db7c0c163 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:46.172724 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2aa6d0f8-a828-4d80-b67c-a81db7c0c163 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:46.202544 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2aa6d0f8-a828-4d80-b67c-a81db7c0c163 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042787 Jul 01 07:25:46.203120 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 558/1163] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:25:46 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:46.213889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-dd854336-0af7-4b7c-ac61-9a4f933c8943 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:46.214466 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-dd854336-0af7-4b7c-ac61-9a4f933c8943 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:46.220666 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd854336-0af7-4b7c-ac61-9a4f933c8943 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:46.221108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd854336-0af7-4b7c-ac61-9a4f933c8943 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:46.221862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd854336-0af7-4b7c-ac61-9a4f933c8943 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:46.222293 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-dd854336-0af7-4b7c-ac61-9a4f933c8943 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:46.250075 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-dd854336-0af7-4b7c-ac61-9a4f933c8943 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/6a001c06-5dad-4bc1-8220-908d3bf27769" status: 200 len: 194 microversion: 2.1 time: 0.040985 Jul 01 07:25:46.250642 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 606/1164] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jul 1 07:25:46 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/6a001c06-5dad-4bc1-8220-908d3bf27769 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:47.562593 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a4e7f6e7-abf9-4b51-9f4a-9f366a97f284 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3402681c-fcc8-423f-a334-772926771941"}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:25:47.563675 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-a4e7f6e7-abf9-4b51-9f4a-9f366a97f284 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:47.570625 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a4e7f6e7-abf9-4b51-9f4a-9f366a97f284 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:47.571104 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a4e7f6e7-abf9-4b51-9f4a-9f366a97f284 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:47.571864 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a4e7f6e7-abf9-4b51-9f4a-9f366a97f284 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:47.572331 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-a4e7f6e7-abf9-4b51-9f4a-9f366a97f284 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:47.818568 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a4e7f6e7-abf9-4b51-9f4a-9f366a97f284 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "POST /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259691 Jul 01 07:25:47.819247 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 559/1165] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jul 1 07:25:47 2022] POST /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:55.292344 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-badbdd4f-228c-4d24-a5fe-8ca29022aecc tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:55.293317 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-badbdd4f-228c-4d24-a5fe-8ca29022aecc tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:55.299803 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-badbdd4f-228c-4d24-a5fe-8ca29022aecc tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:55.300251 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-badbdd4f-228c-4d24-a5fe-8ca29022aecc tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:55.301041 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-badbdd4f-228c-4d24-a5fe-8ca29022aecc tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:55.301472 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-badbdd4f-228c-4d24-a5fe-8ca29022aecc tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:55.329744 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-badbdd4f-228c-4d24-a5fe-8ca29022aecc tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041354 Jul 01 07:25:55.330277 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 607/1166] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:25:55 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:55.468211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2db90ef4-fc11-4c33-9f24-9fef6dba9cf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:55.468746 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2db90ef4-fc11-4c33-9f24-9fef6dba9cf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:55.475604 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2db90ef4-fc11-4c33-9f24-9fef6dba9cf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:55.476059 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2db90ef4-fc11-4c33-9f24-9fef6dba9cf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:55.476827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2db90ef4-fc11-4c33-9f24-9fef6dba9cf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:55.477268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2db90ef4-fc11-4c33-9f24-9fef6dba9cf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:55.504692 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2db90ef4-fc11-4c33-9f24-9fef6dba9cf3 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/6a001c06-5dad-4bc1-8220-908d3bf27769" status: 200 len: 194 microversion: 2.1 time: 0.041352 Jul 01 07:25:55.505257 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 560/1167] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jul 1 07:25:55 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/6a001c06-5dad-4bc1-8220-908d3bf27769 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:55.514586 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5d10f7d3-ae02-40d1-9ee1-70c5492ea956 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:55.515109 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5d10f7d3-ae02-40d1-9ee1-70c5492ea956 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:55.521584 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d10f7d3-ae02-40d1-9ee1-70c5492ea956 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:55.522030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d10f7d3-ae02-40d1-9ee1-70c5492ea956 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:55.522812 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d10f7d3-ae02-40d1-9ee1-70c5492ea956 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:55.523254 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5d10f7d3-ae02-40d1-9ee1-70c5492ea956 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:55.601216 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-5d10f7d3-ae02-40d1-9ee1-70c5492ea956 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lazy-loading 'services' on Instance uuid 98643912-ee1a-41a7-a96b-c740cc8c03ce {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:25:55.670751 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5d10f7d3-ae02-40d1-9ee1-70c5492ea956 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/6a001c06-5dad-4bc1-8220-908d3bf27769" status: 202 len: 0 microversion: 2.1 time: 0.159859 Jul 01 07:25:55.671365 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 608/1168] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:25:55 2022] DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/6a001c06-5dad-4bc1-8220-908d3bf27769 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:25:56.781810 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-89213fae-2803-48a1-835b-e465884cd385 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:56.782369 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-89213fae-2803-48a1-835b-e465884cd385 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:56.789921 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-89213fae-2803-48a1-835b-e465884cd385 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:56.790946 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-89213fae-2803-48a1-835b-e465884cd385 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:56.791731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-89213fae-2803-48a1-835b-e465884cd385 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:56.792171 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-89213fae-2803-48a1-835b-e465884cd385 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:56.823506 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-89213fae-2803-48a1-835b-e465884cd385 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/3402681c-fcc8-423f-a334-772926771941" status: 200 len: 194 microversion: 2.1 time: 0.046663 Jul 01 07:25:56.824096 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 561/1169] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jul 1 07:25:56 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/3402681c-fcc8-423f-a334-772926771941 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:25:56.835391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-745b253d-e5fe-477c-bb14-ea1e05983079 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:56.835976 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-745b253d-e5fe-477c-bb14-ea1e05983079 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:56.842119 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-745b253d-e5fe-477c-bb14-ea1e05983079 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:56.842589 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-745b253d-e5fe-477c-bb14-ea1e05983079 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:56.843374 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-745b253d-e5fe-477c-bb14-ea1e05983079 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:56.843816 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-745b253d-e5fe-477c-bb14-ea1e05983079 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:56.923660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.objects.instance [None req-745b253d-e5fe-477c-bb14-ea1e05983079 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lazy-loading 'services' on Instance uuid 98643912-ee1a-41a7-a96b-c740cc8c03ce {{(pid=117835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 07:25:56.994144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-745b253d-e5fe-477c-bb14-ea1e05983079 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/3402681c-fcc8-423f-a334-772926771941" status: 202 len: 0 microversion: 2.1 time: 0.163994 Jul 01 07:25:56.994713 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 609/1170] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jul 1 07:25:56 2022] DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments/3402681c-fcc8-423f-a334-772926771941 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:25:58.151979 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-823cdf19-57cb-448c-832c-2ab25a3e2291 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:58.152918 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-823cdf19-57cb-448c-832c-2ab25a3e2291 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:58.159480 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-823cdf19-57cb-448c-832c-2ab25a3e2291 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:58.159930 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-823cdf19-57cb-448c-832c-2ab25a3e2291 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:58.160684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-823cdf19-57cb-448c-832c-2ab25a3e2291 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:58.161116 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-823cdf19-57cb-448c-832c-2ab25a3e2291 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:58.189296 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-823cdf19-57cb-448c-832c-2ab25a3e2291 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041185 Jul 01 07:25:58.189845 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 562/1171] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:25:58 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:25:58.295111 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b0dfd76e-bd66-4d1d-93d3-dcd853a50d3c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:58.296116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b0dfd76e-bd66-4d1d-93d3-dcd853a50d3c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:58.302843 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0dfd76e-bd66-4d1d-93d3-dcd853a50d3c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:58.303297 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0dfd76e-bd66-4d1d-93d3-dcd853a50d3c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:58.304068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0dfd76e-bd66-4d1d-93d3-dcd853a50d3c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:58.304556 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b0dfd76e-bd66-4d1d-93d3-dcd853a50d3c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:58.333168 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b0dfd76e-bd66-4d1d-93d3-dcd853a50d3c tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042894 Jul 01 07:25:58.333718 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 610/1172] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jul 1 07:25:58 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 07:25:58.389214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-d66bcca9-ac1e-40f9-83a6-6420cf140841 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:58.389707 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d66bcca9-ac1e-40f9-83a6-6420cf140841 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:58.395630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d66bcca9-ac1e-40f9-83a6-6420cf140841 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:58.396078 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d66bcca9-ac1e-40f9-83a6-6420cf140841 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:58.396835 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d66bcca9-ac1e-40f9-83a6-6420cf140841 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:58.397272 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-d66bcca9-ac1e-40f9-83a6-6420cf140841 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:58.420864 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-d66bcca9-ac1e-40f9-83a6-6420cf140841 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:25:58.494876 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-d66bcca9-ac1e-40f9-83a6-6420cf140841 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 204 len: 0 microversion: 2.1 time: 0.108968 Jul 01 07:25:58.495576 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 563/1173] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:25:58 2022] DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:25:58.504530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b613b57a-bceb-438c-9315-9bf4d52daed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:58.505148 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-b613b57a-bceb-438c-9315-9bf4d52daed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:58.511373 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b613b57a-bceb-438c-9315-9bf4d52daed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:58.511853 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b613b57a-bceb-438c-9315-9bf4d52daed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:58.512616 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b613b57a-bceb-438c-9315-9bf4d52daed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:58.513043 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-b613b57a-bceb-438c-9315-9bf4d52daed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:58.639952 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-b613b57a-bceb-438c-9315-9bf4d52daed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:25:58.647500 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b613b57a-bceb-438c-9315-9bf4d52daed0 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1674 microversion: 2.1 time: 0.147480 Jul 01 07:25:58.648069 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 611/1174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:25:58 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:25:59.665168 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-2a3d67a9-19a4-494d-9bba-ec2780324a3a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:25:59.665900 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-2a3d67a9-19a4-494d-9bba-ec2780324a3a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:25:59.672255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a3d67a9-19a4-494d-9bba-ec2780324a3a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:59.672700 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a3d67a9-19a4-494d-9bba-ec2780324a3a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:59.673452 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a3d67a9-19a4-494d-9bba-ec2780324a3a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:25:59.673884 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-2a3d67a9-19a4-494d-9bba-ec2780324a3a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:25:59.799351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-2a3d67a9-19a4-494d-9bba-ec2780324a3a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:25:59.807529 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-2a3d67a9-19a4-494d-9bba-ec2780324a3a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1674 microversion: 2.1 time: 0.146552 Jul 01 07:25:59.808091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 564/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:25:59 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:26:00.825165 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9f127a15-7f26-4a10-b5e0-2b0db8671fa9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:00.825890 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9f127a15-7f26-4a10-b5e0-2b0db8671fa9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:26:00.833083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f127a15-7f26-4a10-b5e0-2b0db8671fa9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:00.833531 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f127a15-7f26-4a10-b5e0-2b0db8671fa9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:00.834310 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f127a15-7f26-4a10-b5e0-2b0db8671fa9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:00.834743 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9f127a15-7f26-4a10-b5e0-2b0db8671fa9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:01.331318 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9f127a15-7f26-4a10-b5e0-2b0db8671fa9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b26629e86b43dfaacc4de87a26ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c0ce09b9e34dd1a5dcce0a3e37fe31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:26:01.338663 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9f127a15-7f26-4a10-b5e0-2b0db8671fa9 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 200 len: 1674 microversion: 2.1 time: 0.517374 Jul 01 07:26:01.339256 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 612/1176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:26:00 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 1674 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:26:01.861781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-997aa53b-cfd2-41df-bbe4-f3ca2e2c5f86 req-a6706d20-7be0-4af8-9895-4c03d212b9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98643912-ee1a-41a7-a96b-c740cc8c03ce", "name": "network-vif-deleted", "tag": "d67a72c6-fe01-44b2-8397-1c61bcf4bbf8"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:26:01.873328 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-997aa53b-cfd2-41df-bbe4-f3ca2e2c5f86 req-a6706d20-7be0-4af8-9895-4c03d212b9c1 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:01.873781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-997aa53b-cfd2-41df-bbe4-f3ca2e2c5f86 req-a6706d20-7be0-4af8-9895-4c03d212b9c1 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:01.886184 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-997aa53b-cfd2-41df-bbe4-f3ca2e2c5f86 req-a6706d20-7be0-4af8-9895-4c03d212b9c1 service nova] Creating event network-vif-deleted:d67a72c6-fe01-44b2-8397-1c61bcf4bbf8 for instance 98643912-ee1a-41a7-a96b-c740cc8c03ce on hv-cinder-80721 Jul 01 07:26:01.891342 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-997aa53b-cfd2-41df-bbe4-f3ca2e2c5f86 req-a6706d20-7be0-4af8-9895-4c03d212b9c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101026 Jul 01 07:26:01.896417 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 565/1177] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:02.355834 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:02.356448 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:26:02.363129 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:02.363573 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:02.364628 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:02.365073 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:02.379926 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] HTTP exception thrown: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Request method failure captured: Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce HTTP/1.1 Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivqAft7BgLU3nJICdIRza5Vu-Syh7FtoRkLI3TNslNLD9f5gl8WdXzRalosSo61-IUGs34kA7Ntvl-A1aNXnJN_8zzatScAqCVpq_KpG9bBwyo1V-wpMc0t7EIUxBBucVIYoeBxW8W6SQM8Ggl1NSv--KQJ_qRYUdBaNEpRH8ZGpw9FE Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:26:02.381613 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}] Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: a8b26629e86b43dfaacc4de87a26ebd4 Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:02.383150 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '98643912-ee1a-41a7-a96b-c740cc8c03ce'} Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:26:02.384046 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:02.385697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:02.387263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Returning 404 to user: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:26:02.387263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7e7a2291-1d66-4df4-bc5c-7e05e8895525 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 404 len: 111 microversion: 2.1 time: 0.031136 Jul 01 07:26:02.387263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 613/1178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:26:02 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 07:26:02.392697 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-dfeb76e5-3614-40ae-ac67-2a9415b7c7d4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '.version_select at 0x7f2c4a48bca0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:02.411433 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-dfeb76e5-3614-40ae-ac67-2a9415b7c7d4 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109685664" status: 202 len: 0 microversion: 2.1 time: 0.022849 Jul 01 07:26:02.412260 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 566/1179] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jul 1 07:26:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109685664 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 07:26:05.301485 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:05.302026 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:26:05.308842 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:05.309287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:05.310043 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:05.310476 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:05.323821 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] HTTP exception thrown: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Request method failure captured: Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce HTTP/1.1 Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivqAft7BgLU3nJICdIRza5Vu-Syh7FtoRkLI3TNslNLD9f5gl8WdXzRalosSo61-IUGs34kA7Ntvl-A1aNXnJN_8zzatScAqCVpq_KpG9bBwyo1V-wpMc0t7EIUxBBucVIYoeBxW8W6SQM8Ggl1NSv--KQJ_qRYUdBaNEpRH8ZGpw9FE Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:26:05.325349 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}] Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: a8b26629e86b43dfaacc4de87a26ebd4 Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.326935 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '98643912-ee1a-41a7-a96b-c740cc8c03ce'} Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:26:05.327836 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.329434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.331030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Returning 404 to user: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:26:05.331030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-00d76508-2673-4467-b923-b4e3dc57c639 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 404 len: 111 microversion: 2.1 time: 0.029807 Jul 01 07:26:05.331030 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 614/1180] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:26:05 2022] DELETE /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:26:05.335064 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:05.335782 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 98643912-ee1a-41a7-a96b-c740cc8c03ce] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:26:05.342314 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:05.342757 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:05.343817 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:05.344260 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:05.359668 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] HTTP exception thrown: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Request method failure captured: Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce HTTP/1.1 Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivqAft7BgLU3nJICdIRza5Vu-Syh7FtoRkLI3TNslNLD9f5gl8WdXzRalosSo61-IUGs34kA7Ntvl-A1aNXnJN_8zzatScAqCVpq_KpG9bBwyo1V-wpMc0t7EIUxBBucVIYoeBxW8W6SQM8Ggl1NSv--KQJ_qRYUdBaNEpRH8ZGpw9FE Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:26:05.361360 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}] Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: a8b26629e86b43dfaacc4de87a26ebd4 Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.363627 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '98643912-ee1a-41a7-a96b-c740cc8c03ce'} Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:26:05.364409 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. Jul 01 07:26:05.365682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:05.366875 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Returning 404 to user: Instance 98643912-ee1a-41a7-a96b-c740cc8c03ce could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:26:05.366875 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-449b7538-bd30-48f8-975e-d43064a152e5 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce" status: 404 len: 111 microversion: 2.1 time: 0.031567 Jul 01 07:26:05.366875 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 567/1181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:26:05 2022] GET /compute/v2.1/servers/98643912-ee1a-41a7-a96b-c740cc8c03ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 07:26:06.493299 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:06.493806 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:26:06.500235 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:06.500691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:06.501494 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:06.501933 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:06.515752 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] HTTP exception thrown: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Request method failure captured: Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: DELETE /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 HTTP/1.1 Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivqAft7BgLU3nJICdIRza5Vu-Syh7FtoRkLI3TNslNLD9f5gl8WdXzRalosSo61-IUGs34kA7Ntvl-A1aNXnJN_8zzatScAqCVpq_KpG9bBwyo1V-wpMc0t7EIUxBBucVIYoeBxW8W6SQM8Ggl1NSv--KQJ_qRYUdBaNEpRH8ZGpw9FE Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:26:06.517279 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}] Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: a8b26629e86b43dfaacc4de87a26ebd4 Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.519011 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '9423db7b-518f-4627-aa50-6db6c04d7ec4'} Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:26:06.519849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.521103 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.522588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Returning 404 to user: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:26:06.522588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-344f52a5-1749-4b64-8de8-a34e50e1a776 tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 404 len: 111 microversion: 2.1 time: 0.029250 Jul 01 07:26:06.522588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 615/1182] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:26:06 2022] DELETE /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:26:06.526899 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:06.527517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] [instance: 9423db7b-518f-4627-aa50-6db6c04d7ec4] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:26:06.533886 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:06.534335 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:06.535151 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:26:06.535588 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:26:06.549076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] HTTP exception thrown: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Request method failure captured: Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 HTTP/1.1 Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivqAft7BgLU3nJICdIRza5Vu-Syh7FtoRkLI3TNslNLD9f5gl8WdXzRalosSo61-IUGs34kA7Ntvl-A1aNXnJN_8zzatScAqCVpq_KpG9bBwyo1V-wpMc0t7EIUxBBucVIYoeBxW8W6SQM8Ggl1NSv--KQJ_qRYUdBaNEpRH8ZGpw9FE Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:26:06.551174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1c0ce09b9e34dd1a5dcce0a3e37fe31"}]}] Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: a1c0ce09b9e34dd1a5dcce0a3e37fe31 Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1728900682 Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: a8b26629e86b43dfaacc4de87a26ebd4 Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-AttachVolumeTestJSON-1728900682-project Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.552801 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '9423db7b-518f-4627-aa50-6db6c04d7ec4'} Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:26:06.553664 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. Jul 01 07:26:06.555208 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:26:06.556898 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] Returning 404 to user: Instance 9423db7b-518f-4627-aa50-6db6c04d7ec4 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:26:06.556898 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-c0a403a8-09a9-4f0f-bacc-21284ff16b7a tempest-AttachVolumeTestJSON-1728900682 tempest-AttachVolumeTestJSON-1728900682-project] 10.222.0.48 "GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4" status: 404 len: 111 microversion: 2.1 time: 0.029484 Jul 01 07:26:06.556898 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 568/1183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:26:06 2022] GET /compute/v2.1/servers/9423db7b-518f-4627-aa50-6db6c04d7ec4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:26:12.171790 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-dcb5455b-b0a6-4718-ab21-d981430350a6 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a3cbc10>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:12.218757 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-dcb5455b-b0a6-4718-ab21-d981430350a6 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8690b0c9-bbbe-4adf-a960-b786f9924836" status: 200 len: 350 microversion: 2.1 time: 0.050648 Jul 01 07:26:12.219346 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 616/1184] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:26:12 2022] GET /compute/v2.1/os-volumes/8690b0c9-bbbe-4adf-a960-b786f9924836 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:13.525502 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ef99f31c-f580-400a-8804-9b4c70fe7093 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a4f84c0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:13.572536 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ef99f31c-f580-400a-8804-9b4c70fe7093 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/31e573cc-d8ff-4929-9cb5-1649bfda9c9d" status: 200 len: 351 microversion: 2.1 time: 0.050759 Jul 01 07:26:13.573090 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 569/1185] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:26:13 2022] GET /compute/v2.1/os-volumes/31e573cc-d8ff-4929-9cb5-1649bfda9c9d => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:14.877689 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-496bb899-19d3-40f7-8287-4a9a041fe811 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a3af9d0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:14.925989 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-496bb899-19d3-40f7-8287-4a9a041fe811 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/17071269-3e78-4dae-b85c-8507ea9be1ac" status: 200 len: 350 microversion: 2.1 time: 0.052602 Jul 01 07:26:14.926549 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 617/1186] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jul 1 07:26:14 2022] GET /compute/v2.1/os-volumes/17071269-3e78-4dae-b85c-8507ea9be1ac => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:14.938242 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-a774fa29-ef82-4dee-8f9d-15ea3516adca tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a555670>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:15.021904 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-a774fa29-ef82-4dee-8f9d-15ea3516adca tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087781 Jul 01 07:26:15.022464 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 570/1187] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jul 1 07:26:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:26:15.035177 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-02326d78-60b7-42e3-a304-3b46569f2b8f tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a3afe50>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:15.119851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-02326d78-60b7-42e3-a304-3b46569f2b8f tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088828 Jul 01 07:26:15.120416 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 618/1188] 10.222.0.48 () {58 vars in 1148 bytes} [Fri Jul 1 07:26:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:15.132039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6083055e-63d6-45ec-a287-ef09a98db248 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a748790>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:15.212063 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6083055e-63d6-45ec-a287-ef09a98db248 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083732 Jul 01 07:26:15.212636 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 571/1189] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jul 1 07:26:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:26:15.224145 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9481f953-28bf-45d6-ae6c-a546aa50d13c tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a36ddc0>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:15.304946 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9481f953-28bf-45d6-ae6c-a546aa50d13c tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085100 Jul 01 07:26:15.305530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 619/1190] 10.222.0.48 () {58 vars in 1166 bytes} [Fri Jul 1 07:26:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:15.317085 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3dc9fb91-fe10-4f2b-be91-168793bcd08c tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a6c09d0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:15.397086 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3dc9fb91-fe10-4f2b-be91-168793bcd08c tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083644 Jul 01 07:26:15.397641 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 572/1191] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Jul 1 07:26:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:15.410019 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-542a1d48-eb80-4c36-9b64-c96e4f7ec0c0 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a3dda60>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:15.490141 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-542a1d48-eb80-4c36-9b64-c96e4f7ec0c0 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084590 Jul 01 07:26:15.490712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 620/1192] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jul 1 07:26:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:26:15.501531 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-05ec0904-36f9-4cbd-bdff-ec3b2ec70451 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a5964c0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:15.580037 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-05ec0904-36f9-4cbd-bdff-ec3b2ec70451 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082144 Jul 01 07:26:15.580604 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 573/1193] 10.222.0.48 () {58 vars in 1187 bytes} [Fri Jul 1 07:26:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:15.592548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-b2ed552a-9ccb-4c98-80cb-d356448f89c2 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] Calling method '.version_select at 0x7f2c4a3af310>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:26:15.845831 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-b2ed552a-9ccb-4c98-80cb-d356448f89c2 tempest-VolumesTestJSON-76753753 tempest-VolumesTestJSON-76753753-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.256987 Jul 01 07:26:15.846452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 621/1194] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jul 1 07:26:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:26:50.834445 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:26:50.835240 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:26:51.032019 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:26:51.032767 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:26:51.262651 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4363ec69-c635-49c3-be29-cb4f1aa2bc30 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Action: 'create', calling method: .version_select at 0x7f2c4a682ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-376246792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzH2SEHDayKmD5uVMSK9k6xmerMEQpQwfbNRMvEOw+qrWqNL+OoleMLUCb6cgplRR/CufOGo8kJK4MJT3dlGm2LMdh0qJ7AknOFu3F2/YuZjI33pXTb/9pp832Ntus4Tg=="}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:26:51.277714 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-4363ec69-c635-49c3-be29-cb4f1aa2bc30 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Getting quotas for project f12c0a38c96d474e98388f240d002d71. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:26:51.281471 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-4363ec69-c635-49c3-be29-cb4f1aa2bc30 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Getting quotas for user 3c6974def201473f9a8398e300cdd6ea and project f12c0a38c96d474e98388f240d002d71. Resources: {'key_pairs'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:26:51.306537 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4363ec69-c635-49c3-be29-cb4f1aa2bc30 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.275438 Jul 01 07:26:51.307267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 574/1195] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jul 1 07:26:51 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:26:52.035810 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:26:52.036395 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:26:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:26:56.787628 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:26:56.788188 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:26:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:27:12.720530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=22 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:27:12.721297 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:27:12.726280 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-258150044", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-376246792", "security_groups": [{"name": "tempest-secgroup-smoke-804161265"}], "block_device_mapping_v2": [{"uuid": "83ee09f7-0c86-474e-b5d9-4213e830558c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c23ec499-2b45-4521-ac94-469b4bb5e414"}]}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:27:12.834953 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] validate_networks() for [('c23ec499-2b45-4521-ac94-469b4bb5e414', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:27:13.197960 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:27:13.198388 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:27:13.198897 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:27:13.199311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:27:13.199724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:27:13.208990 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:13.209454 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:13.210252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:13.210691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:13.227599 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Getting quotas for project f12c0a38c96d474e98388f240d002d71. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:27:13.231535 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Getting quotas for user 3c6974def201473f9a8398e300cdd6ea and project f12c0a38c96d474e98388f240d002d71. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:27:13.293595 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:27:13.295717 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83ee09f7-0c86-474e-b5d9-4213e830558c',volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:27:13.423909 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-efecaa5d-b3dc-46b3-b7c1-e86b63a09736 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704871 Jul 01 07:27:13.424716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 622/1196] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:27:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:27:13.432104 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=4 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:27:13.433180 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:27:13.437020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-22393233-5c9e-43f0-a507-b5b2566d49e0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:13.437670 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-22393233-5c9e-43f0-a507-b5b2566d49e0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:13.498787 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-22393233-5c9e-43f0-a507-b5b2566d49e0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:13.507608 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-22393233-5c9e-43f0-a507-b5b2566d49e0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1093 microversion: 2.1 time: 0.076652 Jul 01 07:27:13.508156 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 575/1197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:13 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:14.524798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-77801aed-8d2b-49e8-ba90-61ea58c2fded tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:14.526063 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-77801aed-8d2b-49e8-ba90-61ea58c2fded tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:14.532460 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77801aed-8d2b-49e8-ba90-61ea58c2fded tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:14.532955 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77801aed-8d2b-49e8-ba90-61ea58c2fded tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:14.533724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77801aed-8d2b-49e8-ba90-61ea58c2fded tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:14.534170 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-77801aed-8d2b-49e8-ba90-61ea58c2fded tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:14.610278 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-77801aed-8d2b-49e8-ba90-61ea58c2fded tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:14.617727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-77801aed-8d2b-49e8-ba90-61ea58c2fded tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1209 microversion: 2.1 time: 0.097326 Jul 01 07:27:14.618276 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 623/1198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:14 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:15.634929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9cd2ef8a-45d9-4a0a-bc0b-a053ead3b4d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:15.636730 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9cd2ef8a-45d9-4a0a-bc0b-a053ead3b4d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:15.644105 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9cd2ef8a-45d9-4a0a-bc0b-a053ead3b4d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:15.644558 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9cd2ef8a-45d9-4a0a-bc0b-a053ead3b4d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:15.645333 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9cd2ef8a-45d9-4a0a-bc0b-a053ead3b4d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:15.645766 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9cd2ef8a-45d9-4a0a-bc0b-a053ead3b4d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:15.823442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9cd2ef8a-45d9-4a0a-bc0b-a053ead3b4d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:15.830897 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9cd2ef8a-45d9-4a0a-bc0b-a053ead3b4d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.200150 Jul 01 07:27:15.831451 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 576/1199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:15 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:15.928387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-8d2c0002-b91c-40c7-a068-75904587fd66 req-508dffb9-f8c0-413f-8a42-f37a0cd3a67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5ccaba-c1b1-449d-8b60-e4b284e4ba28", "tag": "73c0c6c4-38de-4c34-a960-9f1f78a31b0a"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:27:15.941132 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-8d2c0002-b91c-40c7-a068-75904587fd66 req-508dffb9-f8c0-413f-8a42-f37a0cd3a67d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:15.941572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-8d2c0002-b91c-40c7-a068-75904587fd66 req-508dffb9-f8c0-413f-8a42-f37a0cd3a67d service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:15.953488 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-8d2c0002-b91c-40c7-a068-75904587fd66 req-508dffb9-f8c0-413f-8a42-f37a0cd3a67d service nova] Creating event network-changed:73c0c6c4-38de-4c34-a960-9f1f78a31b0a for instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 on hv-cinder-80721 Jul 01 07:27:15.968116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-8d2c0002-b91c-40c7-a068-75904587fd66 req-508dffb9-f8c0-413f-8a42-f37a0cd3a67d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044255 Jul 01 07:27:15.968730 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 624/1200] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:27:16.847734 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b45fcc49-e301-461e-b842-6d81003a5ade tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:16.848345 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b45fcc49-e301-461e-b842-6d81003a5ade tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:16.854799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b45fcc49-e301-461e-b842-6d81003a5ade tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:16.855251 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b45fcc49-e301-461e-b842-6d81003a5ade tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:16.856008 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b45fcc49-e301-461e-b842-6d81003a5ade tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:16.856438 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b45fcc49-e301-461e-b842-6d81003a5ade tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:16.996374 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b45fcc49-e301-461e-b842-6d81003a5ade tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:17.003717 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b45fcc49-e301-461e-b842-6d81003a5ade tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.159867 Jul 01 07:27:17.004272 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 577/1201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:16 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:18.022364 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-62136067-018f-43d3-a782-c64d04fc1b75 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:18.023094 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-62136067-018f-43d3-a782-c64d04fc1b75 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:18.029278 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-62136067-018f-43d3-a782-c64d04fc1b75 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:18.029673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-62136067-018f-43d3-a782-c64d04fc1b75 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:18.030436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-62136067-018f-43d3-a782-c64d04fc1b75 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:18.030903 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-62136067-018f-43d3-a782-c64d04fc1b75 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:18.159384 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-62136067-018f-43d3-a782-c64d04fc1b75 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:18.166708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-62136067-018f-43d3-a782-c64d04fc1b75 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.149690 Jul 01 07:27:18.167288 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 625/1202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:18 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:19.183907 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5ff24225-6ba1-4449-a347-b7fd1222506f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:19.184499 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5ff24225-6ba1-4449-a347-b7fd1222506f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:19.191011 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ff24225-6ba1-4449-a347-b7fd1222506f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:19.191466 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ff24225-6ba1-4449-a347-b7fd1222506f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:19.192237 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ff24225-6ba1-4449-a347-b7fd1222506f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:19.192672 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ff24225-6ba1-4449-a347-b7fd1222506f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:19.320514 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5ff24225-6ba1-4449-a347-b7fd1222506f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:19.327928 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5ff24225-6ba1-4449-a347-b7fd1222506f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.148200 Jul 01 07:27:19.328494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 578/1203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:19 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:20.344345 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-31ed9925-40ff-4f9f-a93f-d5039910d0a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:20.344954 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-31ed9925-40ff-4f9f-a93f-d5039910d0a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:20.351910 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-31ed9925-40ff-4f9f-a93f-d5039910d0a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:20.352353 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-31ed9925-40ff-4f9f-a93f-d5039910d0a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:20.353110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-31ed9925-40ff-4f9f-a93f-d5039910d0a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:20.353540 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-31ed9925-40ff-4f9f-a93f-d5039910d0a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:20.487245 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-31ed9925-40ff-4f9f-a93f-d5039910d0a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:20.495330 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-31ed9925-40ff-4f9f-a93f-d5039910d0a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.155017 Jul 01 07:27:20.495896 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 626/1204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:20 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:21.512178 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-9e288472-ad3d-45fc-be6e-2ad6684aaf5d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:21.512722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-9e288472-ad3d-45fc-be6e-2ad6684aaf5d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:21.519348 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9e288472-ad3d-45fc-be6e-2ad6684aaf5d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:21.519827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9e288472-ad3d-45fc-be6e-2ad6684aaf5d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:21.520596 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9e288472-ad3d-45fc-be6e-2ad6684aaf5d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:21.521031 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-9e288472-ad3d-45fc-be6e-2ad6684aaf5d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:21.648788 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-9e288472-ad3d-45fc-be6e-2ad6684aaf5d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:21.656294 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-9e288472-ad3d-45fc-be6e-2ad6684aaf5d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.148089 Jul 01 07:27:21.656856 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 579/1205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:21 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:22.673135 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-0134410e-ba2a-4bb8-9dd9-6a5aafd3af4a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:22.673744 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-0134410e-ba2a-4bb8-9dd9-6a5aafd3af4a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:22.680146 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0134410e-ba2a-4bb8-9dd9-6a5aafd3af4a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:22.680591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0134410e-ba2a-4bb8-9dd9-6a5aafd3af4a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:22.681612 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0134410e-ba2a-4bb8-9dd9-6a5aafd3af4a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:22.682040 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-0134410e-ba2a-4bb8-9dd9-6a5aafd3af4a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:22.812474 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-0134410e-ba2a-4bb8-9dd9-6a5aafd3af4a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:22.820524 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-0134410e-ba2a-4bb8-9dd9-6a5aafd3af4a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.151258 Jul 01 07:27:22.821087 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 627/1206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:22 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:23.837595 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-b5e088cd-c709-4e06-8815-e68aaf897a78 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:23.838201 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-b5e088cd-c709-4e06-8815-e68aaf897a78 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:23.840504 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:27:23.845810 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5e088cd-c709-4e06-8815-e68aaf897a78 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:23.846257 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5e088cd-c709-4e06-8815-e68aaf897a78 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:23.847037 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5e088cd-c709-4e06-8815-e68aaf897a78 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:23.847468 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-b5e088cd-c709-4e06-8815-e68aaf897a78 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:23.982839 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-b5e088cd-c709-4e06-8815-e68aaf897a78 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:23.990171 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-b5e088cd-c709-4e06-8815-e68aaf897a78 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.156942 Jul 01 07:27:23.990722 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 580/1207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:23 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:25.006980 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-90b84e94-4f32-435b-a26f-640532d249de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:25.007598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-90b84e94-4f32-435b-a26f-640532d249de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:25.009479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:27:25.010126 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=6 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:27:25.016397 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-90b84e94-4f32-435b-a26f-640532d249de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:25.016844 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-90b84e94-4f32-435b-a26f-640532d249de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:25.017598 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-90b84e94-4f32-435b-a26f-640532d249de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:25.018031 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-90b84e94-4f32-435b-a26f-640532d249de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:25.152174 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-90b84e94-4f32-435b-a26f-640532d249de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:25.159691 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-90b84e94-4f32-435b-a26f-640532d249de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.157133 Jul 01 07:27:25.160323 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 628/1208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:25 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:26.177799 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-3f138f0e-140f-4c7b-bfc8-c9ad91e0ea52 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:26.178428 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-3f138f0e-140f-4c7b-bfc8-c9ad91e0ea52 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:26.185286 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3f138f0e-140f-4c7b-bfc8-c9ad91e0ea52 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:26.185731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3f138f0e-140f-4c7b-bfc8-c9ad91e0ea52 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:26.186482 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3f138f0e-140f-4c7b-bfc8-c9ad91e0ea52 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:26.186948 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-3f138f0e-140f-4c7b-bfc8-c9ad91e0ea52 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:26.312998 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-3f138f0e-140f-4c7b-bfc8-c9ad91e0ea52 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:26.320332 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-3f138f0e-140f-4c7b-bfc8-c9ad91e0ea52 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.147017 Jul 01 07:27:26.320885 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 581/1209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:26 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:27.337234 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-9fe92952-1333-46d7-acaa-29a93c3e72fd tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:27.337849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-9fe92952-1333-46d7-acaa-29a93c3e72fd tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:27.344808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9fe92952-1333-46d7-acaa-29a93c3e72fd tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:27.345415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9fe92952-1333-46d7-acaa-29a93c3e72fd tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:27.346217 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9fe92952-1333-46d7-acaa-29a93c3e72fd tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:27.346639 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-9fe92952-1333-46d7-acaa-29a93c3e72fd tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:27.423068 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-51c7fc8f-0512-4a7f-821b-008e058ecefa req-556a9f78-fe44-4312-8399-f226db3cf33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5ccaba-c1b1-449d-8b60-e4b284e4ba28", "name": "network-vif-plugged", "status": "completed", "tag": "73c0c6c4-38de-4c34-a960-9f1f78a31b0a"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:27:27.432088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-51c7fc8f-0512-4a7f-821b-008e058ecefa req-556a9f78-fe44-4312-8399-f226db3cf33b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:27.432541 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-51c7fc8f-0512-4a7f-821b-008e058ecefa req-556a9f78-fe44-4312-8399-f226db3cf33b service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:27.444125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-51c7fc8f-0512-4a7f-821b-008e058ecefa req-556a9f78-fe44-4312-8399-f226db3cf33b service nova] Creating event network-vif-plugged:73c0c6c4-38de-4c34-a960-9f1f78a31b0a for instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 on hv-cinder-80721 Jul 01 07:27:27.449248 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-51c7fc8f-0512-4a7f-821b-008e058ecefa req-556a9f78-fe44-4312-8399-f226db3cf33b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093772 Jul 01 07:27:27.449837 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 582/1210] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:27:27.487882 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-9fe92952-1333-46d7-acaa-29a93c3e72fd tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:27.496295 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-9fe92952-1333-46d7-acaa-29a93c3e72fd tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.163205 Jul 01 07:27:27.496865 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 629/1211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:27 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:28.514462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-7388e421-1d91-406f-8a27-049dca330b2e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:28.515116 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-7388e421-1d91-406f-8a27-049dca330b2e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:28.521959 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7388e421-1d91-406f-8a27-049dca330b2e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:28.522407 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7388e421-1d91-406f-8a27-049dca330b2e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:28.523211 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7388e421-1d91-406f-8a27-049dca330b2e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:28.523652 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-7388e421-1d91-406f-8a27-049dca330b2e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:28.662582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-7388e421-1d91-406f-8a27-049dca330b2e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:28.670210 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-7388e421-1d91-406f-8a27-049dca330b2e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1264 microversion: 2.1 time: 0.160465 Jul 01 07:27:28.670794 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 583/1212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:28 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:29.688344 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d13fdaa3-a700-4fa0-9c1d-08a1f489e40c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:29.688959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d13fdaa3-a700-4fa0-9c1d-08a1f489e40c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:29.695641 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d13fdaa3-a700-4fa0-9c1d-08a1f489e40c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:29.696091 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d13fdaa3-a700-4fa0-9c1d-08a1f489e40c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:29.696859 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d13fdaa3-a700-4fa0-9c1d-08a1f489e40c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:29.697298 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d13fdaa3-a700-4fa0-9c1d-08a1f489e40c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:29.828229 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d13fdaa3-a700-4fa0-9c1d-08a1f489e40c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:29.836252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d13fdaa3-a700-4fa0-9c1d-08a1f489e40c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1451 microversion: 2.1 time: 0.151790 Jul 01 07:27:29.836808 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 630/1213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:29 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:29.852542 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-bfc855c3-22a7-4d2d-af1b-cd2ace7799e5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:27:29.853162 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-bfc855c3-22a7-4d2d-af1b-cd2ace7799e5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:27:29.859678 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bfc855c3-22a7-4d2d-af1b-cd2ace7799e5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:29.860129 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bfc855c3-22a7-4d2d-af1b-cd2ace7799e5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:29.860890 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bfc855c3-22a7-4d2d-af1b-cd2ace7799e5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:29.861326 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-bfc855c3-22a7-4d2d-af1b-cd2ace7799e5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:29.988610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-bfc855c3-22a7-4d2d-af1b-cd2ace7799e5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:27:30.004324 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-bfc855c3-22a7-4d2d-af1b-cd2ace7799e5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1451 microversion: 2.1 time: 0.156173 Jul 01 07:27:30.005397 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 584/1214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:27:29 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:27:31.608515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-9addb0dc-4a84-4177-88c3-3e23f0738105 req-d680c29f-3315-486e-9ea2-efc8c9e8d032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5ccaba-c1b1-449d-8b60-e4b284e4ba28", "tag": "73c0c6c4-38de-4c34-a960-9f1f78a31b0a"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:27:31.617107 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-9addb0dc-4a84-4177-88c3-3e23f0738105 req-d680c29f-3315-486e-9ea2-efc8c9e8d032 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:27:31.617543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-9addb0dc-4a84-4177-88c3-3e23f0738105 req-d680c29f-3315-486e-9ea2-efc8c9e8d032 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:27:31.628796 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-9addb0dc-4a84-4177-88c3-3e23f0738105 req-d680c29f-3315-486e-9ea2-efc8c9e8d032 service nova] Creating event network-changed:73c0c6c4-38de-4c34-a960-9f1f78a31b0a for instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 on hv-cinder-80721 Jul 01 07:27:31.634795 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-9addb0dc-4a84-4177-88c3-3e23f0738105 req-d680c29f-3315-486e-9ea2-efc8c9e8d032 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030284 Jul 01 07:27:31.635716 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 631/1215] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:29:45.556701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR oslo.messaging._drivers.impl_rabbit [-] [efcb0a95-e2d3-4a5a-9025-bd302b338987] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 07:29:45.557289 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=22 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:29:45.557968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=50 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:29:45.561976 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-83117bf1-1d41-4f07-9197-4c2e332b93eb tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:45.562466 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-83117bf1-1d41-4f07-9197-4c2e332b93eb tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:45.569183 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-83117bf1-1d41-4f07-9197-4c2e332b93eb tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:45.569630 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-83117bf1-1d41-4f07-9197-4c2e332b93eb tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:45.570393 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-83117bf1-1d41-4f07-9197-4c2e332b93eb tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:45.570857 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-83117bf1-1d41-4f07-9197-4c2e332b93eb tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:45.594815 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-83117bf1-1d41-4f07-9197-4c2e332b93eb tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:29:45.665858 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-83117bf1-1d41-4f07-9197-4c2e332b93eb tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 204 len: 0 microversion: 2.1 time: 0.111395 Jul 01 07:29:45.666442 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 585/1216] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:29:45 2022] DELETE /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:29:45.674036 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR oslo.messaging._drivers.impl_rabbit [-] [08479886-34f6-49f0-8456-d1055ad58431] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 07:29:45.675476 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:29:45.676194 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=48 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:29:45.680731 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-324d386d-f657-4b8b-b38a-9bbf8b309a2b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:45.681425 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-324d386d-f657-4b8b-b38a-9bbf8b309a2b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:45.688817 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-324d386d-f657-4b8b-b38a-9bbf8b309a2b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:45.689262 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-324d386d-f657-4b8b-b38a-9bbf8b309a2b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:45.690542 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-324d386d-f657-4b8b-b38a-9bbf8b309a2b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:45.690996 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-324d386d-f657-4b8b-b38a-9bbf8b309a2b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:45.872755 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-324d386d-f657-4b8b-b38a-9bbf8b309a2b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:45.880769 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-324d386d-f657-4b8b-b38a-9bbf8b309a2b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1576 microversion: 2.1 time: 0.209704 Jul 01 07:29:45.881329 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 632/1217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:45 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:46.899035 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-86bb1bff-8749-4cd6-8e7f-af8b73e74a06 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:46.899743 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-86bb1bff-8749-4cd6-8e7f-af8b73e74a06 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:46.907255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-86bb1bff-8749-4cd6-8e7f-af8b73e74a06 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:46.907708 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-86bb1bff-8749-4cd6-8e7f-af8b73e74a06 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:46.909116 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-86bb1bff-8749-4cd6-8e7f-af8b73e74a06 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:46.909552 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-86bb1bff-8749-4cd6-8e7f-af8b73e74a06 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:46.915432 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] [efcb0a95-e2d3-4a5a-9025-bd302b338987] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60332. Jul 01 07:29:47.096653 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-86bb1bff-8749-4cd6-8e7f-af8b73e74a06 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:47.104089 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-86bb1bff-8749-4cd6-8e7f-af8b73e74a06 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1576 microversion: 2.1 time: 0.209437 Jul 01 07:29:47.104647 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 586/1218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:46 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:48.121228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-83b2a1c8-47b0-4f94-9100-b1a321c3f4c2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:48.121838 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-83b2a1c8-47b0-4f94-9100-b1a321c3f4c2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:48.130064 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c8-47b0-4f94-9100-b1a321c3f4c2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:48.130515 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c8-47b0-4f94-9100-b1a321c3f4c2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:48.131303 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c8-47b0-4f94-9100-b1a321c3f4c2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:48.131742 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c8-47b0-4f94-9100-b1a321c3f4c2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:48.138317 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] [08479886-34f6-49f0-8456-d1055ad58431] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60338. Jul 01 07:29:48.200410 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-83b2a1c8-47b0-4f94-9100-b1a321c3f4c2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:48.208050 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-83b2a1c8-47b0-4f94-9100-b1a321c3f4c2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 200 len: 1509 microversion: 2.1 time: 0.090835 Jul 01 07:29:48.208839 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 633/1219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:48 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 1509 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:48.357606 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-e09c473b-e0fb-4f76-95df-52940f9d588a req-86089a12-2f73-49e9-a45d-9c4a3ea800dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5ccaba-c1b1-449d-8b60-e4b284e4ba28", "name": "network-vif-deleted", "tag": "73c0c6c4-38de-4c34-a960-9f1f78a31b0a"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:29:48.368079 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-e09c473b-e0fb-4f76-95df-52940f9d588a req-86089a12-2f73-49e9-a45d-9c4a3ea800dc service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:48.368525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-e09c473b-e0fb-4f76-95df-52940f9d588a req-86089a12-2f73-49e9-a45d-9c4a3ea800dc service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:48.380555 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-e09c473b-e0fb-4f76-95df-52940f9d588a req-86089a12-2f73-49e9-a45d-9c4a3ea800dc service nova] Creating event network-vif-deleted:73c0c6c4-38de-4c34-a960-9f1f78a31b0a for instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 on hv-cinder-80721 Jul 01 07:29:48.385953 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-e09c473b-e0fb-4f76-95df-52940f9d588a req-86089a12-2f73-49e9-a45d-9c4a3ea800dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032225 Jul 01 07:29:48.387290 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 587/1220] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:29:49.225651 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:49.227006 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:49.234270 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:49.234721 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:49.235543 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:49.235981 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:49.249476 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] HTTP exception thrown: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Request method failure captured: Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 HTTP/1.1 Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivqG1dTkwBpPaA7zhmZVu7UxGP6ruYw6KqCha4NHqgReAWH-2dnw7AzaO9C8VTNu7KRt5_WGS6XzlZH7IUF5enrOb6iPcrTQBILbWRd6nsbV1Odlbo7yvt1Y-ECtuUC-n6l4fRN6T5qLDk9E4s4p6RW1TXCRqT8wGsuwL8ZVxmnJoy18 Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:29:49.251184 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f12c0a38c96d474e98388f240d002d71"}]}] Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 3c6974def201473f9a8398e300cdd6ea Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:29:49.252798 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '5c5ccaba-c1b1-449d-8b60-e4b284e4ba28'} Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:29:49.253733 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:29:49.255228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:29:49.257928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Returning 404 to user: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:29:49.258889 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-69dc5dd0-6364-4ce2-886d-e0748d1af6e3 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 404 len: 111 microversion: 2.1 time: 0.037124 Jul 01 07:29:49.259534 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 634/1221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:49 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:29:49.307238 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-747850351", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-376246792", "security_groups": [{"name": "tempest-secgroup-smoke-804161265"}], "block_device_mapping_v2": [{"uuid": "83ee09f7-0c86-474e-b5d9-4213e830558c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c23ec499-2b45-4521-ac94-469b4bb5e414"}]}} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:29:49.417604 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.network.neutron [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] validate_networks() for [('c23ec499-2b45-4521-ac94-469b4bb5e414', None, None, None, None, None)] {{(pid=117836) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:29:49.825868 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Flavor limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:29:49.826287 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Image limits 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:29:49.826751 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Flavor pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:29:49.827184 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Image pref 0:0:0 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:29:49.827595 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.virt.hardware [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:29:49.836303 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:49.836741 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:49.837525 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:49.837956 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:49.854112 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Getting quotas for project f12c0a38c96d474e98388f240d002d71. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:29:49.858306 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.quota [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Getting quotas for user 3c6974def201473f9a8398e300cdd6ea and project f12c0a38c96d474e98388f240d002d71. Resources: {'cores', 'instances', 'ram'} {{(pid=117836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:29:49.913857 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Going to run 1 instances... {{(pid=117836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:29:49.916142 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83ee09f7-0c86-474e-b5d9-4213e830558c',volume_size=None,volume_type=None)] {{(pid=117836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:29:50.041007 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ffaf83e2-3457-48c3-aa74-dab2ae3f2ab7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738230 Jul 01 07:29:50.041637 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 588/1222] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:29:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:29:50.052051 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-275a65b3-0b10-4381-87e8-05cda220fb11 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:50.052673 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-275a65b3-0b10-4381-87e8-05cda220fb11 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:50.107292 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-275a65b3-0b10-4381-87e8-05cda220fb11 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:50.118944 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-275a65b3-0b10-4381-87e8-05cda220fb11 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1093 microversion: 2.1 time: 0.071096 Jul 01 07:29:50.119542 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 635/1223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:50 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:51.136263 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-685e6c01-94bc-49df-a64b-df0f95f3ef1c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:51.136882 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-685e6c01-94bc-49df-a64b-df0f95f3ef1c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:51.188681 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-685e6c01-94bc-49df-a64b-df0f95f3ef1c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:51.195829 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-685e6c01-94bc-49df-a64b-df0f95f3ef1c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1093 microversion: 2.1 time: 0.063831 Jul 01 07:29:51.196381 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 589/1224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:51 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:52.213655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-90574593-e9fc-4233-a18e-f3b36056fbfe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:52.213655 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-90574593-e9fc-4233-a18e-f3b36056fbfe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:52.267116 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-90574593-e9fc-4233-a18e-f3b36056fbfe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:52.273876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-90574593-e9fc-4233-a18e-f3b36056fbfe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1093 microversion: 2.1 time: 0.064686 Jul 01 07:29:52.274453 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 636/1225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:52 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:53.290229 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-da39f48b-6002-457b-aabf-1a38b5ab23f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:53.290833 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-da39f48b-6002-457b-aabf-1a38b5ab23f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:53.345145 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-da39f48b-6002-457b-aabf-1a38b5ab23f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:53.353694 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-da39f48b-6002-457b-aabf-1a38b5ab23f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1093 microversion: 2.1 time: 0.067331 Jul 01 07:29:53.354270 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 590/1226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:53 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:54.380434 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-c2a68cc4-f134-4591-9970-f59f85fef620 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:54.381052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-c2a68cc4-f134-4591-9970-f59f85fef620 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:54.388922 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c2a68cc4-f134-4591-9970-f59f85fef620 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:54.389370 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c2a68cc4-f134-4591-9970-f59f85fef620 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:54.390161 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c2a68cc4-f134-4591-9970-f59f85fef620 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:54.390591 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-c2a68cc4-f134-4591-9970-f59f85fef620 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:54.451900 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-c2a68cc4-f134-4591-9970-f59f85fef620 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:54.460026 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-c2a68cc4-f134-4591-9970-f59f85fef620 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1143 microversion: 2.1 time: 0.091841 Jul 01 07:29:54.460771 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 637/1227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:54 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:55.476849 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5928714d-cbb4-45db-9582-423f1ee944f2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:55.477462 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5928714d-cbb4-45db-9582-423f1ee944f2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:55.484756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5928714d-cbb4-45db-9582-423f1ee944f2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:55.485152 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5928714d-cbb4-45db-9582-423f1ee944f2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:55.485925 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5928714d-cbb4-45db-9582-423f1ee944f2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:55.486361 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5928714d-cbb4-45db-9582-423f1ee944f2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:55.581957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5928714d-cbb4-45db-9582-423f1ee944f2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:55.589472 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5928714d-cbb4-45db-9582-423f1ee944f2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1209 microversion: 2.1 time: 0.116442 Jul 01 07:29:55.590030 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 591/1228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:55 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:56.409105 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-863c5aa0-5435-4955-aa96-23885b7e5fc3 req-e6334b6b-4dab-4e0f-b87f-675e63a70dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64366e25-f357-4d4f-8d52-50eaf7953b6a", "tag": "878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:29:56.417964 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-863c5aa0-5435-4955-aa96-23885b7e5fc3 req-e6334b6b-4dab-4e0f-b87f-675e63a70dab service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:56.418522 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-863c5aa0-5435-4955-aa96-23885b7e5fc3 req-e6334b6b-4dab-4e0f-b87f-675e63a70dab service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:56.432229 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-863c5aa0-5435-4955-aa96-23885b7e5fc3 req-e6334b6b-4dab-4e0f-b87f-675e63a70dab service nova] Creating event network-changed:878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d for instance 64366e25-f357-4d4f-8d52-50eaf7953b6a on hv-cinder-80721 Jul 01 07:29:56.435664 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR oslo.messaging._drivers.impl_rabbit [req-863c5aa0-5435-4955-aa96-23885b7e5fc3 req-e6334b6b-4dab-4e0f-b87f-675e63a70dab service nova] [3c012244-546a-4adc-b253-0f7b8faa8848] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 07:29:56.605889 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5aa40bd2-fba7-4021-838a-7d590804168d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:56.606508 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5aa40bd2-fba7-4021-838a-7d590804168d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:56.613049 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5aa40bd2-fba7-4021-838a-7d590804168d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:56.613505 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5aa40bd2-fba7-4021-838a-7d590804168d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:56.614280 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5aa40bd2-fba7-4021-838a-7d590804168d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:56.614721 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5aa40bd2-fba7-4021-838a-7d590804168d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:56.815042 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5aa40bd2-fba7-4021-838a-7d590804168d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:56.822590 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5aa40bd2-fba7-4021-838a-7d590804168d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.221090 Jul 01 07:29:56.823400 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 592/1229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:56 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 07:29:57.442675 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [req-863c5aa0-5435-4955-aa96-23885b7e5fc3 req-e6334b6b-4dab-4e0f-b87f-675e63a70dab service nova] [3c012244-546a-4adc-b253-0f7b8faa8848] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60396. Jul 01 07:29:57.446108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-863c5aa0-5435-4955-aa96-23885b7e5fc3 req-e6334b6b-4dab-4e0f-b87f-675e63a70dab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.041806 Jul 01 07:29:57.446849 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 638/1230] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:29:57.839984 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e7494a24-93fd-4d54-9c33-c7ce125ce0de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:57.840653 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e7494a24-93fd-4d54-9c33-c7ce125ce0de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:57.848025 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e7494a24-93fd-4d54-9c33-c7ce125ce0de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:57.848480 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e7494a24-93fd-4d54-9c33-c7ce125ce0de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:57.849249 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e7494a24-93fd-4d54-9c33-c7ce125ce0de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:57.849688 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e7494a24-93fd-4d54-9c33-c7ce125ce0de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:58.072684 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e7494a24-93fd-4d54-9c33-c7ce125ce0de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:58.080727 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e7494a24-93fd-4d54-9c33-c7ce125ce0de tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.244082 Jul 01 07:29:58.081296 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 593/1231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:57 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:29:59.098749 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5a80b45f-532b-4c3d-95e5-e6aaf0a5c65e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:29:59.099479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5a80b45f-532b-4c3d-95e5-e6aaf0a5c65e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:29:59.106043 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a80b45f-532b-4c3d-95e5-e6aaf0a5c65e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:59.106494 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a80b45f-532b-4c3d-95e5-e6aaf0a5c65e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:59.107287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a80b45f-532b-4c3d-95e5-e6aaf0a5c65e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:29:59.107724 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5a80b45f-532b-4c3d-95e5-e6aaf0a5c65e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:29:59.241495 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5a80b45f-532b-4c3d-95e5-e6aaf0a5c65e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:29:59.248993 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5a80b45f-532b-4c3d-95e5-e6aaf0a5c65e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.155440 Jul 01 07:29:59.249554 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 639/1232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:29:59 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:00.265698 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e33f9d53-aeb8-4b0c-b000-ae0ac3a36ac8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:00.266311 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e33f9d53-aeb8-4b0c-b000-ae0ac3a36ac8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:00.268739 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:30:00.274306 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e33f9d53-aeb8-4b0c-b000-ae0ac3a36ac8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:00.274756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e33f9d53-aeb8-4b0c-b000-ae0ac3a36ac8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:00.275535 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e33f9d53-aeb8-4b0c-b000-ae0ac3a36ac8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:00.275976 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e33f9d53-aeb8-4b0c-b000-ae0ac3a36ac8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:00.402929 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-e33f9d53-aeb8-4b0c-b000-ae0ac3a36ac8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:00.410255 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e33f9d53-aeb8-4b0c-b000-ae0ac3a36ac8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.148388 Jul 01 07:30:00.410833 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 594/1233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:00 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:01.427086 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-df02e965-59d4-4ef3-ba7a-4aebfb0d4f4d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:01.427707 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-df02e965-59d4-4ef3-ba7a-4aebfb0d4f4d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:01.434449 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-df02e965-59d4-4ef3-ba7a-4aebfb0d4f4d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:01.434937 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-df02e965-59d4-4ef3-ba7a-4aebfb0d4f4d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:01.435708 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-df02e965-59d4-4ef3-ba7a-4aebfb0d4f4d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:01.436149 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-df02e965-59d4-4ef3-ba7a-4aebfb0d4f4d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:01.562727 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-df02e965-59d4-4ef3-ba7a-4aebfb0d4f4d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:01.570754 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-df02e965-59d4-4ef3-ba7a-4aebfb0d4f4d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.147565 Jul 01 07:30:01.571337 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 640/1234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:01 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:02.587204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-90a2a020-8db5-4b9e-904b-cebf664a31a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:02.587726 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-90a2a020-8db5-4b9e-904b-cebf664a31a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:02.594160 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-90a2a020-8db5-4b9e-904b-cebf664a31a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:02.594571 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-90a2a020-8db5-4b9e-904b-cebf664a31a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:02.595957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-90a2a020-8db5-4b9e-904b-cebf664a31a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:02.596398 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-90a2a020-8db5-4b9e-904b-cebf664a31a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:02.727865 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-90a2a020-8db5-4b9e-904b-cebf664a31a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:02.735214 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-90a2a020-8db5-4b9e-904b-cebf664a31a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.151969 Jul 01 07:30:02.735780 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 595/1235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:02 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:03.751971 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2e8b0477-71d6-4f89-b8e7-42a86fd90ec9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:03.752635 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2e8b0477-71d6-4f89-b8e7-42a86fd90ec9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:03.755220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=4 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:30:03.762446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2e8b0477-71d6-4f89-b8e7-42a86fd90ec9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:03.762925 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2e8b0477-71d6-4f89-b8e7-42a86fd90ec9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:03.763704 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2e8b0477-71d6-4f89-b8e7-42a86fd90ec9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:03.764140 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2e8b0477-71d6-4f89-b8e7-42a86fd90ec9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:03.891416 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2e8b0477-71d6-4f89-b8e7-42a86fd90ec9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:03.898821 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2e8b0477-71d6-4f89-b8e7-42a86fd90ec9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.150702 Jul 01 07:30:03.899383 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 641/1236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:03 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:04.915027 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1837d5d9-a55a-406d-83b9-3483aab8135a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:04.915632 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1837d5d9-a55a-406d-83b9-3483aab8135a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:04.917412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=10 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:30:04.923076 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1837d5d9-a55a-406d-83b9-3483aab8135a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:04.923522 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1837d5d9-a55a-406d-83b9-3483aab8135a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:04.924275 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1837d5d9-a55a-406d-83b9-3483aab8135a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:04.925212 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1837d5d9-a55a-406d-83b9-3483aab8135a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:05.054802 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1837d5d9-a55a-406d-83b9-3483aab8135a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:05.062427 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1837d5d9-a55a-406d-83b9-3483aab8135a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.151320 Jul 01 07:30:05.063015 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 596/1237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:04 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:06.079795 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8dbba2c1-ab71-4074-abb4-cc99e251d0f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:06.080418 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8dbba2c1-ab71-4074-abb4-cc99e251d0f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:06.087628 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8dbba2c1-ab71-4074-abb4-cc99e251d0f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:06.088077 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8dbba2c1-ab71-4074-abb4-cc99e251d0f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:06.088846 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8dbba2c1-ab71-4074-abb4-cc99e251d0f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:06.089282 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8dbba2c1-ab71-4074-abb4-cc99e251d0f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:06.219638 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8dbba2c1-ab71-4074-abb4-cc99e251d0f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:06.227115 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8dbba2c1-ab71-4074-abb4-cc99e251d0f7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.151277 Jul 01 07:30:06.227671 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 642/1238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:06 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:07.244038 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-1cb2db24-d1e4-484b-b9b1-040299c14f8e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:07.244650 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-1cb2db24-d1e4-484b-b9b1-040299c14f8e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:07.251143 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cb2db24-d1e4-484b-b9b1-040299c14f8e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:07.251594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cb2db24-d1e4-484b-b9b1-040299c14f8e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:07.252352 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cb2db24-d1e4-484b-b9b1-040299c14f8e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:07.253376 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-1cb2db24-d1e4-484b-b9b1-040299c14f8e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:07.388543 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-1cb2db24-d1e4-484b-b9b1-040299c14f8e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:07.396048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-1cb2db24-d1e4-484b-b9b1-040299c14f8e tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.155876 Jul 01 07:30:07.396619 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 597/1239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:07 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:08.067058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-4b91caaa-b0a3-4480-ad4f-16c4f5d9b6f9 req-5a533fd4-28a2-49ce-9ba1-b75f0eb67308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64366e25-f357-4d4f-8d52-50eaf7953b6a", "name": "network-vif-plugged", "status": "completed", "tag": "878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:30:08.075790 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-4b91caaa-b0a3-4480-ad4f-16c4f5d9b6f9 req-5a533fd4-28a2-49ce-9ba1-b75f0eb67308 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:08.076227 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-4b91caaa-b0a3-4480-ad4f-16c4f5d9b6f9 req-5a533fd4-28a2-49ce-9ba1-b75f0eb67308 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:08.089430 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-4b91caaa-b0a3-4480-ad4f-16c4f5d9b6f9 req-5a533fd4-28a2-49ce-9ba1-b75f0eb67308 service nova] Creating event network-vif-plugged:878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d for instance 64366e25-f357-4d4f-8d52-50eaf7953b6a on hv-cinder-80721 Jul 01 07:30:08.095068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-4b91caaa-b0a3-4480-ad4f-16c4f5d9b6f9 req-5a533fd4-28a2-49ce-9ba1-b75f0eb67308 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031451 Jul 01 07:30:08.096182 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 643/1240] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:30:08.412515 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-03d442a3-7fa8-44d4-b989-f7def4c2a721 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:08.413125 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-03d442a3-7fa8-44d4-b989-f7def4c2a721 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:08.419569 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-03d442a3-7fa8-44d4-b989-f7def4c2a721 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:08.420028 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-03d442a3-7fa8-44d4-b989-f7def4c2a721 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:08.420781 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-03d442a3-7fa8-44d4-b989-f7def4c2a721 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:08.421219 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-03d442a3-7fa8-44d4-b989-f7def4c2a721 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:08.552610 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-03d442a3-7fa8-44d4-b989-f7def4c2a721 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:08.560571 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-03d442a3-7fa8-44d4-b989-f7def4c2a721 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.151990 Jul 01 07:30:08.561136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 598/1241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:08 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:09.579387 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-d5335a10-9f1a-42d5-8488-711e106325d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:09.579998 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-d5335a10-9f1a-42d5-8488-711e106325d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:09.587144 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5335a10-9f1a-42d5-8488-711e106325d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:09.587592 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5335a10-9f1a-42d5-8488-711e106325d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:09.588343 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5335a10-9f1a-42d5-8488-711e106325d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:09.588771 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-d5335a10-9f1a-42d5-8488-711e106325d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:09.727840 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-d5335a10-9f1a-42d5-8488-711e106325d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:09.735110 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-d5335a10-9f1a-42d5-8488-711e106325d0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1264 microversion: 2.1 time: 0.160017 Jul 01 07:30:09.735671 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 644/1242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:09 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:10.751567 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-21207ff1-9fb3-4362-9e49-0810f7ace1b0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:10.752204 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-21207ff1-9fb3-4362-9e49-0810f7ace1b0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:10.759300 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-21207ff1-9fb3-4362-9e49-0810f7ace1b0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:10.759752 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-21207ff1-9fb3-4362-9e49-0810f7ace1b0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:10.760517 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-21207ff1-9fb3-4362-9e49-0810f7ace1b0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:10.760957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-21207ff1-9fb3-4362-9e49-0810f7ace1b0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:10.843436 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:30:10.843874 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:30:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:30:10.887961 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-21207ff1-9fb3-4362-9e49-0810f7ace1b0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:10.895382 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-21207ff1-9fb3-4362-9e49-0810f7ace1b0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1452 microversion: 2.1 time: 0.147644 Jul 01 07:30:10.895951 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 599/1243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:10 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:10.911010 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-5ec2bdb0-e5c5-4368-b52b-a3140202c97f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:30:10.911627 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-5ec2bdb0-e5c5-4368-b52b-a3140202c97f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:30:10.917994 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5ec2bdb0-e5c5-4368-b52b-a3140202c97f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:10.918439 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5ec2bdb0-e5c5-4368-b52b-a3140202c97f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:10.919247 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5ec2bdb0-e5c5-4368-b52b-a3140202c97f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:10.919682 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-5ec2bdb0-e5c5-4368-b52b-a3140202c97f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:11.053804 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-5ec2bdb0-e5c5-4368-b52b-a3140202c97f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:30:11.061572 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-5ec2bdb0-e5c5-4368-b52b-a3140202c97f tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1452 microversion: 2.1 time: 0.154424 Jul 01 07:30:11.062128 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 645/1244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:30:10 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:30:12.044862 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:30:12.045525 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:30:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:30:12.616528 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-f5aab40e-1223-4fcb-9491-649bb5ad1bfe req-c8e6afea-c699-4219-8a38-c52cacced0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64366e25-f357-4d4f-8d52-50eaf7953b6a", "tag": "878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:30:12.626869 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-f5aab40e-1223-4fcb-9491-649bb5ad1bfe req-c8e6afea-c699-4219-8a38-c52cacced0c9 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:30:12.627433 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-f5aab40e-1223-4fcb-9491-649bb5ad1bfe req-c8e6afea-c699-4219-8a38-c52cacced0c9 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:30:12.638807 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-f5aab40e-1223-4fcb-9491-649bb5ad1bfe req-c8e6afea-c699-4219-8a38-c52cacced0c9 service nova] Creating event network-changed:878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d for instance 64366e25-f357-4d4f-8d52-50eaf7953b6a on hv-cinder-80721 Jul 01 07:30:12.644530 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-f5aab40e-1223-4fcb-9491-649bb5ad1bfe req-c8e6afea-c699-4219-8a38-c52cacced0c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035124 Jul 01 07:30:12.645134 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 600/1245] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:31:52.284682 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:31:52.285256 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:31:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:31:56.797866 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:31:56.798566 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:31:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:32:12.355607 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-494058423", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-376246792", "security_groups": [{"name": "tempest-secgroup-smoke-804161265"}], "block_device_mapping_v2": [{"uuid": "806df4eb-287d-4ed8-90fd-e136412936ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c23ec499-2b45-4521-ac94-469b4bb5e414"}]}} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:32:12.363633 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=32 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:32:12.364288 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=60 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:32:12.475337 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.network.neutron [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] validate_networks() for [('c23ec499-2b45-4521-ac94-469b4bb5e414', None, None, None, None, None)] {{(pid=117835) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 07:32:12.883672 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Flavor limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 07:32:12.884138 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Image limits 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 07:32:12.884937 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Flavor pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 07:32:12.885383 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Image pref 0:0:0 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 07:32:12.885796 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.virt.hardware [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 07:32:12.894959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:12.895407 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:12.896208 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:12.896646 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:12.915219 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Getting quotas for project f12c0a38c96d474e98388f240d002d71. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 07:32:12.919126 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.quota [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Getting quotas for user 3c6974def201473f9a8398e300cdd6ea and project f12c0a38c96d474e98388f240d002d71. Resources: {'cores', 'instances', 'ram'} {{(pid=117835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 07:32:12.981159 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Going to run 1 instances... {{(pid=117835) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 07:32:12.983272 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='806df4eb-287d-4ed8-90fd-e136412936ad',volume_size=None,volume_type=None)] {{(pid=117835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 07:32:13.119319 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-ed87dea8-63aa-46af-b0bd-dd8274ed5109 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768462 Jul 01 07:32:13.119961 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 646/1246] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jul 1 07:32:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 07:32:13.130091 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR oslo.messaging._drivers.impl_rabbit [-] [efcb0a95-e2d3-4a5a-9025-bd302b338987] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 01 07:32:13.130719 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:32:13.131503 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:32:13.136557 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5fa3cf5f-cb8f-42ff-9322-5dafdd2c6298 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:13.137279 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5fa3cf5f-cb8f-42ff-9322-5dafdd2c6298 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:13.199821 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5fa3cf5f-cb8f-42ff-9322-5dafdd2c6298 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:13.206579 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5fa3cf5f-cb8f-42ff-9322-5dafdd2c6298 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1093 microversion: 2.1 time: 0.079814 Jul 01 07:32:13.207434 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 601/1247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:13 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:14.224948 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e8973f21-1dee-4117-bae9-2dd1554bc8d9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:14.225914 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e8973f21-1dee-4117-bae9-2dd1554bc8d9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:14.235059 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8973f21-1dee-4117-bae9-2dd1554bc8d9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:14.235927 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8973f21-1dee-4117-bae9-2dd1554bc8d9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:14.237590 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8973f21-1dee-4117-bae9-2dd1554bc8d9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:14.237813 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e8973f21-1dee-4117-bae9-2dd1554bc8d9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:14.445548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e8973f21-1dee-4117-bae9-2dd1554bc8d9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:14.453162 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e8973f21-1dee-4117-bae9-2dd1554bc8d9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1209 microversion: 2.1 time: 0.233596 Jul 01 07:32:14.453738 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 647/1248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:14 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1209 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:15.470549 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5c801cbd-2810-433b-80d4-63023c247076 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:15.471191 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5c801cbd-2810-433b-80d4-63023c247076 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:15.481696 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5c801cbd-2810-433b-80d4-63023c247076 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:15.482155 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5c801cbd-2810-433b-80d4-63023c247076 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:15.482969 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5c801cbd-2810-433b-80d4-63023c247076 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:15.483413 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5c801cbd-2810-433b-80d4-63023c247076 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:15.505507 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] [efcb0a95-e2d3-4a5a-9025-bd302b338987] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60544. Jul 01 07:32:15.698361 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5c801cbd-2810-433b-80d4-63023c247076 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:15.706694 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5c801cbd-2810-433b-80d4-63023c247076 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.239949 Jul 01 07:32:15.707295 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 602/1249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:15 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:15.900531 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-583bf053-4702-4dc6-81c9-f5609fb967a9 req-7ec98570-4b03-493e-9881-d65c6f0c0a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c265be1a-123b-406c-9f65-2c388b89227f", "tag": "aca4995d-bd5c-480a-ab3d-9bdbc8ecc297"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:32:15.909614 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-583bf053-4702-4dc6-81c9-f5609fb967a9 req-7ec98570-4b03-493e-9881-d65c6f0c0a48 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:15.910070 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-583bf053-4702-4dc6-81c9-f5609fb967a9 req-7ec98570-4b03-493e-9881-d65c6f0c0a48 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:15.922538 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-583bf053-4702-4dc6-81c9-f5609fb967a9 req-7ec98570-4b03-493e-9881-d65c6f0c0a48 service nova] Creating event network-changed:aca4995d-bd5c-480a-ab3d-9bdbc8ecc297 for instance c265be1a-123b-406c-9f65-2c388b89227f on hv-cinder-80721 Jul 01 07:32:15.928570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-583bf053-4702-4dc6-81c9-f5609fb967a9 req-7ec98570-4b03-493e-9881-d65c6f0c0a48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106605 Jul 01 07:32:15.929452 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 648/1250] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:32:16.723662 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-137c6e18-d98d-49e8-aebd-da3d8ca9b748 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:16.724285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-137c6e18-d98d-49e8-aebd-da3d8ca9b748 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:16.730859 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-137c6e18-d98d-49e8-aebd-da3d8ca9b748 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:16.731304 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-137c6e18-d98d-49e8-aebd-da3d8ca9b748 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:16.732062 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-137c6e18-d98d-49e8-aebd-da3d8ca9b748 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:16.732493 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-137c6e18-d98d-49e8-aebd-da3d8ca9b748 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:16.860877 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-137c6e18-d98d-49e8-aebd-da3d8ca9b748 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:16.868842 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-137c6e18-d98d-49e8-aebd-da3d8ca9b748 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.149143 Jul 01 07:32:16.869404 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 603/1251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:16 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:17.886120 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-53ef30c4-6383-4d0d-abf8-4547c1c8300c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:17.886851 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-53ef30c4-6383-4d0d-abf8-4547c1c8300c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:17.893479 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-53ef30c4-6383-4d0d-abf8-4547c1c8300c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:17.893930 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-53ef30c4-6383-4d0d-abf8-4547c1c8300c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:17.894703 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-53ef30c4-6383-4d0d-abf8-4547c1c8300c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:17.895165 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-53ef30c4-6383-4d0d-abf8-4547c1c8300c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:18.027665 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-53ef30c4-6383-4d0d-abf8-4547c1c8300c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:18.035061 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-53ef30c4-6383-4d0d-abf8-4547c1c8300c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.153225 Jul 01 07:32:18.036128 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 649/1252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:17 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:19.051534 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-ee9c594b-6ec3-4698-9afc-5c3d864147e4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:19.052137 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-ee9c594b-6ec3-4698-9afc-5c3d864147e4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:19.058821 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee9c594b-6ec3-4698-9afc-5c3d864147e4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:19.059271 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee9c594b-6ec3-4698-9afc-5c3d864147e4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:19.060020 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee9c594b-6ec3-4698-9afc-5c3d864147e4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:19.060448 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-ee9c594b-6ec3-4698-9afc-5c3d864147e4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:19.185855 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-ee9c594b-6ec3-4698-9afc-5c3d864147e4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:19.195512 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-ee9c594b-6ec3-4698-9afc-5c3d864147e4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.147438 Jul 01 07:32:19.196444 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 604/1253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:19 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:20.212083 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-571ec3de-689f-4d53-b0f9-b489909be50a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:20.212631 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-571ec3de-689f-4d53-b0f9-b489909be50a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:20.218875 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-571ec3de-689f-4d53-b0f9-b489909be50a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:20.219330 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-571ec3de-689f-4d53-b0f9-b489909be50a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:20.220104 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-571ec3de-689f-4d53-b0f9-b489909be50a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:20.220546 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-571ec3de-689f-4d53-b0f9-b489909be50a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:20.356603 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-571ec3de-689f-4d53-b0f9-b489909be50a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:20.363945 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-571ec3de-689f-4d53-b0f9-b489909be50a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.155830 Jul 01 07:32:20.364506 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 650/1254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:20 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:21.381153 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-feda33e7-85bd-42cb-9a92-a0f8f8a3e68b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:21.381769 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-feda33e7-85bd-42cb-9a92-a0f8f8a3e68b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:21.388268 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-feda33e7-85bd-42cb-9a92-a0f8f8a3e68b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:21.388720 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-feda33e7-85bd-42cb-9a92-a0f8f8a3e68b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:21.389494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-feda33e7-85bd-42cb-9a92-a0f8f8a3e68b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:21.389936 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-feda33e7-85bd-42cb-9a92-a0f8f8a3e68b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:21.517114 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-feda33e7-85bd-42cb-9a92-a0f8f8a3e68b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:21.524697 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-feda33e7-85bd-42cb-9a92-a0f8f8a3e68b tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.148086 Jul 01 07:32:21.525264 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 605/1255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:21 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:22.541868 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-2dc8ae38-0261-40b8-8f55-b6fa251a0eb8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:22.542413 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-2dc8ae38-0261-40b8-8f55-b6fa251a0eb8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:22.549038 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2dc8ae38-0261-40b8-8f55-b6fa251a0eb8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:22.549487 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2dc8ae38-0261-40b8-8f55-b6fa251a0eb8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:22.550270 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2dc8ae38-0261-40b8-8f55-b6fa251a0eb8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:22.550740 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-2dc8ae38-0261-40b8-8f55-b6fa251a0eb8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:22.677149 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-2dc8ae38-0261-40b8-8f55-b6fa251a0eb8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:22.684787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-2dc8ae38-0261-40b8-8f55-b6fa251a0eb8 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.146849 Jul 01 07:32:22.685295 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 651/1256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:22 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:23.701215 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-6aae0700-ba93-4216-9c2f-78f28a5512d4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:23.701827 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-6aae0700-ba93-4216-9c2f-78f28a5512d4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:23.704195 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell0:SELECT=2 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:32:23.710135 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6aae0700-ba93-4216-9c2f-78f28a5512d4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:23.710582 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6aae0700-ba93-4216-9c2f-78f28a5512d4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:23.711373 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6aae0700-ba93-4216-9c2f-78f28a5512d4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:23.711833 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-6aae0700-ba93-4216-9c2f-78f28a5512d4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:23.843181 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-6aae0700-ba93-4216-9c2f-78f28a5512d4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:23.850697 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-6aae0700-ba93-4216-9c2f-78f28a5512d4 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.153160 Jul 01 07:32:23.851285 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 606/1257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:23 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:24.867094 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-a0690b02-f5f9-4d17-b857-182c3c2aaa2c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:24.867697 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-a0690b02-f5f9-4d17-b857-182c3c2aaa2c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:24.870787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=2 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:32:24.871646 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell0:SELECT=6 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:32:24.876213 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a0690b02-f5f9-4d17-b857-182c3c2aaa2c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:24.876660 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a0690b02-f5f9-4d17-b857-182c3c2aaa2c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:24.877421 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a0690b02-f5f9-4d17-b857-182c3c2aaa2c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:24.877854 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-a0690b02-f5f9-4d17-b857-182c3c2aaa2c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:25.009922 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-a0690b02-f5f9-4d17-b857-182c3c2aaa2c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:25.017391 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-a0690b02-f5f9-4d17-b857-182c3c2aaa2c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.154108 Jul 01 07:32:25.017950 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 652/1258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:24 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:26.034438 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-04e7f65e-0477-453b-b354-b82a3458418d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:26.035625 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-04e7f65e-0477-453b-b354-b82a3458418d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:26.041983 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-04e7f65e-0477-453b-b354-b82a3458418d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:26.042425 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-04e7f65e-0477-453b-b354-b82a3458418d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:26.043273 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-04e7f65e-0477-453b-b354-b82a3458418d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:26.043703 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-04e7f65e-0477-453b-b354-b82a3458418d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:26.173979 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-04e7f65e-0477-453b-b354-b82a3458418d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:26.182177 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-04e7f65e-0477-453b-b354-b82a3458418d tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.151562 Jul 01 07:32:26.182733 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 607/1259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:26 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:26.968932 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-f4846fad-213a-49ca-85b6-134d3431394e req-9588c09a-5e3d-4b4f-82c2-af3ff38e692e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c265be1a-123b-406c-9f65-2c388b89227f", "name": "network-vif-plugged", "status": "completed", "tag": "aca4995d-bd5c-480a-ab3d-9bdbc8ecc297"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:32:26.977867 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-f4846fad-213a-49ca-85b6-134d3431394e req-9588c09a-5e3d-4b4f-82c2-af3ff38e692e service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:26.978311 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-f4846fad-213a-49ca-85b6-134d3431394e req-9588c09a-5e3d-4b4f-82c2-af3ff38e692e service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:26.989440 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-f4846fad-213a-49ca-85b6-134d3431394e req-9588c09a-5e3d-4b4f-82c2-af3ff38e692e service nova] Creating event network-vif-plugged:aca4995d-bd5c-480a-ab3d-9bdbc8ecc297 for instance c265be1a-123b-406c-9f65-2c388b89227f on hv-cinder-80721 Jul 01 07:32:26.994252 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-f4846fad-213a-49ca-85b6-134d3431394e req-9588c09a-5e3d-4b4f-82c2-af3ff38e692e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029084 Jul 01 07:32:26.995015 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 653/1260] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:32:27.198784 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-21bc4980-df43-41d4-b8b7-682fdf5aa53a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:27.199421 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-21bc4980-df43-41d4-b8b7-682fdf5aa53a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:27.205957 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-21bc4980-df43-41d4-b8b7-682fdf5aa53a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:27.206405 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-21bc4980-df43-41d4-b8b7-682fdf5aa53a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:27.207253 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-21bc4980-df43-41d4-b8b7-682fdf5aa53a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:27.207636 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-21bc4980-df43-41d4-b8b7-682fdf5aa53a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:27.365999 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-21bc4980-df43-41d4-b8b7-682fdf5aa53a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:27.373396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-21bc4980-df43-41d4-b8b7-682fdf5aa53a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.178540 Jul 01 07:32:27.373959 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 608/1261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:27 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:28.391453 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-e0641dfc-37c0-4fb9-a0dc-e7c5c91d49be tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:28.392165 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-e0641dfc-37c0-4fb9-a0dc-e7c5c91d49be tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:28.399164 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e0641dfc-37c0-4fb9-a0dc-e7c5c91d49be tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:28.399620 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e0641dfc-37c0-4fb9-a0dc-e7c5c91d49be tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:28.400396 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e0641dfc-37c0-4fb9-a0dc-e7c5c91d49be tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:28.400837 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-e0641dfc-37c0-4fb9-a0dc-e7c5c91d49be tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:28.532392 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-e0641dfc-37c0-4fb9-a0dc-e7c5c91d49be tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:28.540225 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-e0641dfc-37c0-4fb9-a0dc-e7c5c91d49be tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1264 microversion: 2.1 time: 0.153483 Jul 01 07:32:28.540857 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 654/1262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:28 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:29.557717 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-5ff91173-b9ea-4198-9098-b0471119e526 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:29.558267 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-5ff91173-b9ea-4198-9098-b0471119e526 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:29.564669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ff91173-b9ea-4198-9098-b0471119e526 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:29.565117 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ff91173-b9ea-4198-9098-b0471119e526 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:29.565880 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ff91173-b9ea-4198-9098-b0471119e526 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:29.566315 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-5ff91173-b9ea-4198-9098-b0471119e526 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:29.695840 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-5ff91173-b9ea-4198-9098-b0471119e526 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:29.703117 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-5ff91173-b9ea-4198-9098-b0471119e526 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1451 microversion: 2.1 time: 0.149566 Jul 01 07:32:29.703669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 609/1263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:29 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:29.719438 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8fc65b66-67b2-4f24-b5d9-aadeb88bb6c7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:32:29.720060 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8fc65b66-67b2-4f24-b5d9-aadeb88bb6c7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:32:29.726406 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8fc65b66-67b2-4f24-b5d9-aadeb88bb6c7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:29.726893 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8fc65b66-67b2-4f24-b5d9-aadeb88bb6c7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:29.727658 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8fc65b66-67b2-4f24-b5d9-aadeb88bb6c7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:29.728096 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8fc65b66-67b2-4f24-b5d9-aadeb88bb6c7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:29.858142 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8fc65b66-67b2-4f24-b5d9-aadeb88bb6c7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:32:29.865610 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8fc65b66-67b2-4f24-b5d9-aadeb88bb6c7 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1451 microversion: 2.1 time: 0.149962 Jul 01 07:32:29.866290 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 655/1264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:32:29 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:32:31.678046 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-817fbc48-4130-4403-9d30-1bfa5d0713c8 req-4afffe75-f16b-4b22-9ff4-53404c4d3445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c265be1a-123b-406c-9f65-2c388b89227f", "tag": "aca4995d-bd5c-480a-ab3d-9bdbc8ecc297"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:32:31.686668 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-817fbc48-4130-4403-9d30-1bfa5d0713c8 req-4afffe75-f16b-4b22-9ff4-53404c4d3445 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:32:31.687141 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-817fbc48-4130-4403-9d30-1bfa5d0713c8 req-4afffe75-f16b-4b22-9ff4-53404c4d3445 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:32:31.700731 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-817fbc48-4130-4403-9d30-1bfa5d0713c8 req-4afffe75-f16b-4b22-9ff4-53404c4d3445 service nova] Creating event network-changed:aca4995d-bd5c-480a-ab3d-9bdbc8ecc297 for instance c265be1a-123b-406c-9f65-2c388b89227f on hv-cinder-80721 Jul 01 07:32:31.705826 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-817fbc48-4130-4403-9d30-1bfa5d0713c8 req-4afffe75-f16b-4b22-9ff4-53404c4d3445 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 Jul 01 07:32:31.706504 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 610/1265] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:33:32.053904 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:33:32.054390 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:34:33.694589 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:34:33.695368 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG dbcounter [-] [117835] Writing DB stats nova_cell1:SELECT=48 {{(pid=117835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:34:33.699294 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bf958e8b-9b91-4af6-9776-669a59a007ae tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:33.699783 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bf958e8b-9b91-4af6-9776-669a59a007ae tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:33.706039 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR oslo.messaging._drivers.impl_rabbit [-] [efcb0a95-e2d3-4a5a-9025-bd302b338987] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 01 07:34:33.706939 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_api:SELECT=22 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:34:33.707665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG dbcounter [-] [117836] Writing DB stats nova_cell1:SELECT=50 {{(pid=117836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 07:34:33.718985 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf958e8b-9b91-4af6-9776-669a59a007ae tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:33.719446 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf958e8b-9b91-4af6-9776-669a59a007ae tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:33.720372 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf958e8b-9b91-4af6-9776-669a59a007ae tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:33.720815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bf958e8b-9b91-4af6-9776-669a59a007ae tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:33.749228 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bf958e8b-9b91-4af6-9776-669a59a007ae tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Going to try to terminate instance {{(pid=117835) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:34:33.830366 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bf958e8b-9b91-4af6-9776-669a59a007ae tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 204 len: 0 microversion: 2.1 time: 0.137440 Jul 01 07:34:33.834676 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 656/1266] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:34:33 2022] DELETE /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:34:33.841588 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-bdbcdc55-afc5-4bde-b394-611f1bb079fe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:33.842293 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-bdbcdc55-afc5-4bde-b394-611f1bb079fe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:33.848526 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bdbcdc55-afc5-4bde-b394-611f1bb079fe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:33.848975 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bdbcdc55-afc5-4bde-b394-611f1bb079fe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:33.850072 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bdbcdc55-afc5-4bde-b394-611f1bb079fe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:33.850306 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-bdbcdc55-afc5-4bde-b394-611f1bb079fe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:33.861937 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-f242f037-3a0e-45fd-872c-b9e21125b51f req-8eabf8f7-5223-4b67-9b43-4b628da00375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c265be1a-123b-406c-9f65-2c388b89227f", "tag": "aca4995d-bd5c-480a-ab3d-9bdbc8ecc297"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:34:33.870174 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-f242f037-3a0e-45fd-872c-b9e21125b51f req-8eabf8f7-5223-4b67-9b43-4b628da00375 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:33.870602 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-f242f037-3a0e-45fd-872c-b9e21125b51f req-8eabf8f7-5223-4b67-9b43-4b628da00375 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:33.881546 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-f242f037-3a0e-45fd-872c-b9e21125b51f req-8eabf8f7-5223-4b67-9b43-4b628da00375 service nova] Creating event network-changed:aca4995d-bd5c-480a-ab3d-9bdbc8ecc297 for instance c265be1a-123b-406c-9f65-2c388b89227f on hv-cinder-80721 Jul 01 07:34:33.887175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-f242f037-3a0e-45fd-872c-b9e21125b51f req-8eabf8f7-5223-4b67-9b43-4b628da00375 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182919 Jul 01 07:34:33.887756 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 611/1267] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:34:33.990928 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-bdbcdc55-afc5-4bde-b394-611f1bb079fe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:34:33.998380 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-bdbcdc55-afc5-4bde-b394-611f1bb079fe tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1576 microversion: 2.1 time: 0.161920 Jul 01 07:34:33.999197 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 657/1268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:33 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:34:35.019088 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-4769007c-a86b-4708-922d-3cfa4eb09ee2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:35.019785 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-4769007c-a86b-4708-922d-3cfa4eb09ee2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:35.027117 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4769007c-a86b-4708-922d-3cfa4eb09ee2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:35.027568 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4769007c-a86b-4708-922d-3cfa4eb09ee2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:35.028321 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4769007c-a86b-4708-922d-3cfa4eb09ee2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:35.028753 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-4769007c-a86b-4708-922d-3cfa4eb09ee2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:35.032220 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] [efcb0a95-e2d3-4a5a-9025-bd302b338987] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60632. Jul 01 07:34:35.195655 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-4769007c-a86b-4708-922d-3cfa4eb09ee2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:34:35.203301 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-4769007c-a86b-4708-922d-3cfa4eb09ee2 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1576 microversion: 2.1 time: 0.190091 Jul 01 07:34:35.203861 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 612/1269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:35 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:34:36.220792 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-3f654ede-0f16-467c-a70c-e125c9ab0d90 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:36.221404 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-3f654ede-0f16-467c-a70c-e125c9ab0d90 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:36.228051 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f654ede-0f16-467c-a70c-e125c9ab0d90 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:36.228498 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f654ede-0f16-467c-a70c-e125c9ab0d90 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:36.229465 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f654ede-0f16-467c-a70c-e125c9ab0d90 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:36.229899 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-3f654ede-0f16-467c-a70c-e125c9ab0d90 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:36.310586 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-3f654ede-0f16-467c-a70c-e125c9ab0d90 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:34:36.318266 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-3f654ede-0f16-467c-a70c-e125c9ab0d90 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 200 len: 1390 microversion: 2.1 time: 0.101295 Jul 01 07:34:36.327444 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 658/1270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:36 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 1390 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:34:36.327619 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-e5da6382-d571-4da8-beb7-bb3aa99194f7 req-8c1869c8-4847-446c-9b25-45a723096d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c265be1a-123b-406c-9f65-2c388b89227f", "name": "network-vif-deleted", "tag": "aca4995d-bd5c-480a-ab3d-9bdbc8ecc297"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:34:36.330623 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-e5da6382-d571-4da8-beb7-bb3aa99194f7 req-8c1869c8-4847-446c-9b25-45a723096d28 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:36.331100 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-e5da6382-d571-4da8-beb7-bb3aa99194f7 req-8c1869c8-4847-446c-9b25-45a723096d28 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:36.342445 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-e5da6382-d571-4da8-beb7-bb3aa99194f7 req-8c1869c8-4847-446c-9b25-45a723096d28 service nova] Creating event network-vif-deleted:aca4995d-bd5c-480a-ab3d-9bdbc8ecc297 for instance c265be1a-123b-406c-9f65-2c388b89227f on hv-cinder-80721 Jul 01 07:34:36.347396 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-e5da6382-d571-4da8-beb7-bb3aa99194f7 req-8c1869c8-4847-446c-9b25-45a723096d28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029392 Jul 01 07:34:36.347987 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 613/1271] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 07:34:37.334759 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:37.335426 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: c265be1a-123b-406c-9f65-2c388b89227f] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:37.342824 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:37.343287 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:37.344068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:37.344528 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:37.357710 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] HTTP exception thrown: Instance c265be1a-123b-406c-9f65-2c388b89227f could not be found. Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Request method failure captured: Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f HTTP/1.1 Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivqG1dTkwBpPaA7zhmZVu7UxGP6ruYw6KqCha4NHqgReAWH-2dnw7AzaO9C8VTNu7KRt5_WGS6XzlZH7IUF5enrOb6iPcrTQBILbWRd6nsbV1Odlbo7yvt1Y-ECtuUC-n6l4fRN6T5qLDk9E4s4p6RW1TXCRqT8wGsuwL8ZVxmnJoy18 Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:34:37.359398 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f12c0a38c96d474e98388f240d002d71"}]}] Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 3c6974def201473f9a8398e300cdd6ea Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance c265be1a-123b-406c-9f65-2c388b89227f could not be found. Jul 01 07:34:37.361263 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': 'c265be1a-123b-406c-9f65-2c388b89227f'} Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c265be1a-123b-406c-9f65-2c388b89227f could not be found. Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:34:37.362189 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c265be1a-123b-406c-9f65-2c388b89227f could not be found. Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c265be1a-123b-406c-9f65-2c388b89227f could not be found. Jul 01 07:34:37.363787 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:37.365121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Returning 404 to user: Instance c265be1a-123b-406c-9f65-2c388b89227f could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:34:37.365121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8a9a4d99-18d9-4f72-9ff7-e1983408266a tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f" status: 404 len: 111 microversion: 2.1 time: 0.030073 Jul 01 07:34:37.365121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 659/1272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:37 2022] GET /compute/v2.1/servers/c265be1a-123b-406c-9f65-2c388b89227f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:34:40.388239 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cb9cfb56-60da-41f7-a45d-7b94e29f48a0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:40.388824 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cb9cfb56-60da-41f7-a45d-7b94e29f48a0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:40.389220 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [req-f985f60e-86aa-4a8e-8637-4f8533d9c07c req-560037db-79fd-4464-a294-8fba477a1349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64366e25-f357-4d4f-8d52-50eaf7953b6a", "tag": "878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d"}]} {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:34:40.395351 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cb9cfb56-60da-41f7-a45d-7b94e29f48a0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:40.396066 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cb9cfb56-60da-41f7-a45d-7b94e29f48a0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:40.396832 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cb9cfb56-60da-41f7-a45d-7b94e29f48a0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:40.397476 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cb9cfb56-60da-41f7-a45d-7b94e29f48a0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:40.398175 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-f985f60e-86aa-4a8e-8637-4f8533d9c07c req-560037db-79fd-4464-a294-8fba477a1349 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:40.398682 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [req-f985f60e-86aa-4a8e-8637-4f8533d9c07c req-560037db-79fd-4464-a294-8fba477a1349 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:40.410589 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.compute.server_external_events [req-f985f60e-86aa-4a8e-8637-4f8533d9c07c req-560037db-79fd-4464-a294-8fba477a1349 service nova] Creating event network-changed:878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d for instance 64366e25-f357-4d4f-8d52-50eaf7953b6a on hv-cinder-80721 Jul 01 07:34:40.416117 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [req-f985f60e-86aa-4a8e-8637-4f8533d9c07c req-560037db-79fd-4464-a294-8fba477a1349 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030523 Jul 01 07:34:40.416959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 660/1273] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:34:40.424372 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cb9cfb56-60da-41f7-a45d-7b94e29f48a0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Going to try to terminate instance {{(pid=117836) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 07:34:40.513665 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cb9cfb56-60da-41f7-a45d-7b94e29f48a0 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "DELETE /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 204 len: 0 microversion: 2.1 time: 0.128756 Jul 01 07:34:40.514258 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 614/1274] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:34:40 2022] DELETE /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 07:34:40.523617 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-85e7a9b7-e7ab-4514-99e9-6b3a855fde68 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:40.524607 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-85e7a9b7-e7ab-4514-99e9-6b3a855fde68 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:40.534486 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85e7a9b7-e7ab-4514-99e9-6b3a855fde68 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:40.535108 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85e7a9b7-e7ab-4514-99e9-6b3a855fde68 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:40.535934 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85e7a9b7-e7ab-4514-99e9-6b3a855fde68 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:40.536668 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-85e7a9b7-e7ab-4514-99e9-6b3a855fde68 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:40.672509 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-85e7a9b7-e7ab-4514-99e9-6b3a855fde68 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:34:40.680959 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-85e7a9b7-e7ab-4514-99e9-6b3a855fde68 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1577 microversion: 2.1 time: 0.161531 Jul 01 07:34:40.681530 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 661/1275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:40 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:34:41.698415 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-cf3907ad-72d6-4421-b029-3935a79eacb5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:41.699153 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-cf3907ad-72d6-4421-b029-3935a79eacb5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:41.705500 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cf3907ad-72d6-4421-b029-3935a79eacb5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:41.705952 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cf3907ad-72d6-4421-b029-3935a79eacb5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:41.706712 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cf3907ad-72d6-4421-b029-3935a79eacb5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:41.707175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-cf3907ad-72d6-4421-b029-3935a79eacb5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:41.861494 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.policy [None req-cf3907ad-72d6-4421-b029-3935a79eacb5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117836) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:34:41.869591 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-cf3907ad-72d6-4421-b029-3935a79eacb5 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1577 microversion: 2.1 time: 0.175936 Jul 01 07:34:41.870145 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 615/1276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:41 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:34:42.886696 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-8cd3eeb2-329a-40cb-bfa5-a171b0e542c9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:42.887283 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-8cd3eeb2-329a-40cb-bfa5-a171b0e542c9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:42.893678 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8cd3eeb2-329a-40cb-bfa5-a171b0e542c9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:42.894124 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8cd3eeb2-329a-40cb-bfa5-a171b0e542c9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:42.894936 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8cd3eeb2-329a-40cb-bfa5-a171b0e542c9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:42.895359 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-8cd3eeb2-329a-40cb-bfa5-a171b0e542c9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:43.345533 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.policy [None req-8cd3eeb2-329a-40cb-bfa5-a171b0e542c9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6974def201473f9a8398e300cdd6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c0a38c96d474e98388f240d002d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117835) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 07:34:43.353121 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-8cd3eeb2-329a-40cb-bfa5-a171b0e542c9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 200 len: 1458 microversion: 2.1 time: 0.470398 Jul 01 07:34:43.353967 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 662/1277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:42 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 1458 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 07:34:43.521594 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [req-a973d7d4-7331-44c7-977c-96ec779034c7 req-bee23b32-1142-434e-a455-2a234135dd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64366e25-f357-4d4f-8d52-50eaf7953b6a", "name": "network-vif-deleted", "tag": "878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d"}]} {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 07:34:43.537195 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-a973d7d4-7331-44c7-977c-96ec779034c7 req-bee23b32-1142-434e-a455-2a234135dd19 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:43.537878 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [req-a973d7d4-7331-44c7-977c-96ec779034c7 req-bee23b32-1142-434e-a455-2a234135dd19 service nova] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:43.550509 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.compute.server_external_events [req-a973d7d4-7331-44c7-977c-96ec779034c7 req-bee23b32-1142-434e-a455-2a234135dd19 service nova] Creating event network-vif-deleted:878a3c8f-7cef-48ef-9c51-d2f0d0c5e90d for instance 64366e25-f357-4d4f-8d52-50eaf7953b6a on hv-cinder-80721 Jul 01 07:34:43.559131 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [req-a973d7d4-7331-44c7-977c-96ec779034c7 req-bee23b32-1142-434e-a455-2a234135dd19 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040378 Jul 01 07:34:43.560046 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 616/1278] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jul 1 07:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 07:34:44.370058 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:44.370675 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 64366e25-f357-4d4f-8d52-50eaf7953b6a] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:44.377362 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:44.377813 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:44.378578 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:44.379052 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:44.392900 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] HTTP exception thrown: Instance 64366e25-f357-4d4f-8d52-50eaf7953b6a could not be found. Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Request method failure captured: Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a HTTP/1.1 Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivqG1dTkwBpPaA7zhmZVu7UxGP6ruYw6KqCha4NHqgReAWH-2dnw7AzaO9C8VTNu7KRt5_WGS6XzlZH7IUF5enrOb6iPcrTQBILbWRd6nsbV1Odlbo7yvt1Y-ECtuUC-n6l4fRN6T5qLDk9E4s4p6RW1TXCRqT8wGsuwL8ZVxmnJoy18 Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:34:44.394563 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f12c0a38c96d474e98388f240d002d71"}]}] Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 3c6974def201473f9a8398e300cdd6ea Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 64366e25-f357-4d4f-8d52-50eaf7953b6a could not be found. Jul 01 07:34:44.396357 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '64366e25-f357-4d4f-8d52-50eaf7953b6a'} Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64366e25-f357-4d4f-8d52-50eaf7953b6a could not be found. Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:34:44.397324 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64366e25-f357-4d4f-8d52-50eaf7953b6a could not be found. Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64366e25-f357-4d4f-8d52-50eaf7953b6a could not be found. Jul 01 07:34:44.399068 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.400570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Returning 404 to user: Instance 64366e25-f357-4d4f-8d52-50eaf7953b6a could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:34:44.400570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-7610da58-9ecd-4e9f-a382-dcec6c235e3c tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a" status: 404 len: 111 microversion: 2.1 time: 0.030291 Jul 01 07:34:44.400570 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 663/1279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:44 2022] GET /compute/v2.1/servers/64366e25-f357-4d4f-8d52-50eaf7953b6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:34:44.838358 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:44.838968 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.compute.api [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117836) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:44.845048 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:44.845490 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:44.846240 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:44.846669 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG oslo_concurrency.lockutils [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:44.860244 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.wsgi [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] HTTP exception thrown: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Request method failure captured: Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: request: DELETE /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 HTTP/1.1 Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept: application/json Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Accept-Encoding: identity Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Connection: close Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Length: 0 Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Content-Type: application/json Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Host: 10.222.0.48 Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Openstack-System-Scope: None Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: User-Agent: python-urllib3/1.26.9 Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Auth-Token: gAAAAABivqG1dTkwBpPaA7zhmZVu7UxGP6ruYw6KqCha4NHqgReAWH-2dnw7AzaO9C8VTNu7KRt5_WGS6XzlZH7IUF5enrOb6iPcrTQBILbWRd6nsbV1Odlbo7yvt1Y-ECtuUC-n6l4fRN6T5qLDk9E4s4p6RW1TXCRqT8wGsuwL8ZVxmnJoy18 Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Id: None Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Domain-Name: None Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Identity-Status: Confirmed Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Is-Admin-Project: True Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Id: default Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Domain-Name: Default Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Project-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Role: reader,member Jul 01 07:34:44.861867 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Roles: reader,member Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f12c0a38c96d474e98388f240d002d71"}]}] Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Id: default Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Domain-Name: Default Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Id: 3c6974def201473f9a8398e300cdd6ea Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: X-User-Name: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: method: > Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: exception: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.863676 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: action_args: {'id': '5c5ccaba-c1b1-449d-8b60-e4b284e4ba28'} Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:34:44.864814 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.866496 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.868175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Returning 404 to user: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. {{(pid=117836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:34:44.868175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-e498e30a-3646-4c98-8612-f00c59796f09 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 404 len: 111 microversion: 2.1 time: 0.030177 Jul 01 07:34:44.868175 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 617/1280] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jul 1 07:34:44 2022] DELETE /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:34:44.871756 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '>' {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:44.872372 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.compute.api [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] [instance: 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28] Fetching instance by UUID {{(pid=117835) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 07:34:44.878415 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:44.878930 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:44.879694 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 07:34:44.880132 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG oslo_concurrency.lockutils [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Lock "a747ebb4-7590-42b4-a916-aba82f80a3cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 07:34:44.893227 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.wsgi [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] HTTP exception thrown: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Request method failure captured: Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: request: GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 HTTP/1.1 Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept: application/json Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Accept-Encoding: identity Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Connection: close Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Length: 0 Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Content-Type: application/json Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Host: 10.222.0.48 Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Openstack-System-Scope: None Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: User-Agent: python-urllib3/1.26.9 Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Auth-Token: gAAAAABivqG1dTkwBpPaA7zhmZVu7UxGP6ruYw6KqCha4NHqgReAWH-2dnw7AzaO9C8VTNu7KRt5_WGS6XzlZH7IUF5enrOb6iPcrTQBILbWRd6nsbV1Odlbo7yvt1Y-ECtuUC-n6l4fRN6T5qLDk9E4s4p6RW1TXCRqT8wGsuwL8ZVxmnJoy18 Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Id: None Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Domain-Name: None Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Identity-Status: Confirmed Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Is-Admin-Project: True Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Id: default Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Domain-Name: Default Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Project-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Role: reader,member Jul 01 07:34:44.894712 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Roles: reader,member Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f12c0a38c96d474e98388f240d002d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f12c0a38c96d474e98388f240d002d71"}]}] Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Id: f12c0a38c96d474e98388f240d002d71 Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281505776 Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Id: default Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Domain-Name: Default Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Id: 3c6974def201473f9a8398e300cdd6ea Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: X-User-Name: tempest-TestVolumeBootPattern-1281505776-project Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: method: > Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: exception: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.896548 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: action_args: {'id': '5c5ccaba-c1b1-449d-8b60-e4b284e4ba28'} Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: {{(pid=117835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 07:34:44.897532 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. Jul 01 07:34:44.899402 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: ERROR nova.api.openstack.wsgi Jul 01 07:34:44.900815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: DEBUG nova.api.openstack.wsgi [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Returning 404 to user: Instance 5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 could not be found. {{(pid=117835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 07:34:44.900815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO nova.api.openstack.requestlog [None req-1616de34-8364-4fb8-b63a-fdd7713305a9 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28" status: 404 len: 111 microversion: 2.1 time: 0.028147 Jul 01 07:34:44.900815 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: [pid: 117835|app: 0|req: 664/1281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jul 1 07:34:44 2022] GET /compute/v2.1/servers/5c5ccaba-c1b1-449d-8b60-e4b284e4ba28 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 07:34:46.183394 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: DEBUG nova.api.openstack.wsgi [None req-17aa1e24-a812-4775-8642-9981c7c752c1 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] Calling method '.version_select at 0x7f2c4a1e04c0>' {{(pid=117836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 07:34:46.206412 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO nova.api.openstack.requestlog [None req-17aa1e24-a812-4775-8642-9981c7c752c1 tempest-TestVolumeBootPattern-1281505776 tempest-TestVolumeBootPattern-1281505776-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-376246792" status: 202 len: 0 microversion: 2.1 time: 0.027121 Jul 01 07:34:46.211659 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: [pid: 117836|app: 0|req: 618/1282] 10.222.0.48 () {58 vars in 1259 bytes} [Fri Jul 1 07:34:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-376246792 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 07:35:10.854989 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:35:10.855615 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:35:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:35:16.806044 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:35:16.806531 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:35:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:36:52.062313 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:36:52.062982 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:36:52.294715 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:36:52.295415 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:37:02.718915 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:37:02.719527 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:37:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:37:21.668701 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:37:21.669276 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:37:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:38:30.862876 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:38:30.863522 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:38:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:38:36.814237 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:38:36.814870 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:40:12.071079 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:40:12.071682 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:40:12.302136 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:40:12.302670 dv-cinder-807215-2-iscsi devstack@n-api.service[117836]: Fri Jul 1 07:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 07:40:22.727677 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 07:40:22.728255 dv-cinder-807215-2-iscsi devstack@n-api.service[117835]: Fri Jul 1 07:40:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!